Max level shown:
12025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
22025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
32025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
62025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
82025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
92025-01-13T22:45:01.074ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
132025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
142025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
162025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
172025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
182025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
192025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
202025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
212025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
222025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
232025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
242025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
252025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
262025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
272025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
282025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
292025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
302025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
312025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
322025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
332025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
342025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
362025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
372025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
382025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
392025-01-13T22:45:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
402025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
412025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
422025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
432025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
442025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
452025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
462025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
472025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
482025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
492025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
502025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
512025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
522025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
532025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
542025-01-13T22:45:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
552025-01-13T22:45:01.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
562025-01-13T22:45:01.078ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.241504ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
572025-01-13T22:45:01.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.287356ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
582025-01-13T22:45:01.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
592025-01-13T22:45:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
602025-01-13T22:45:01.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
612025-01-13T22:45:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
622025-01-13T22:45:01.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f04111c6-2b44-4d13-b39d-572684478d23 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
632025-01-13T22:45:01.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f04111c6-2b44-4d13-b39d-572684478d23 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
642025-01-13T22:45:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
652025-01-13T22:45:01.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
662025-01-13T22:45:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
672025-01-13T22:45:01.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2760, tv_nsec: 706535496 } })
682025-01-13T22:45:01.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
692025-01-13T22:45:01.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
702025-01-13T22:45:01.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
712025-01-13T22:45:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
722025-01-13T22:45:01.088ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
732025-01-13T22:45:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
742025-01-13T22:45:01.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
752025-01-13T22:45:01.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
762025-01-13T22:45:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
772025-01-13T22:45:01.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2760, tv_nsec: 711923645 } })
782025-01-13T22:45:01.090ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
792025-01-13T22:45:01.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
802025-01-13T22:45:01.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
812025-01-13T22:45:01.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
822025-01-13T22:45:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
832025-01-13T22:45:01.093ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
842025-01-13T22:45:01.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f04111c6-2b44-4d13-b39d-572684478d23 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
852025-01-13T22:45:01.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
862025-01-13T22:45:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
872025-01-13T22:45:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
882025-01-13T22:45:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
892025-01-13T22:45:01.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
902025-01-13T22:45:01.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
912025-01-13T22:45:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
922025-01-13T22:45:01.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932025-01-13T22:45:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
942025-01-13T22:45:01.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
952025-01-13T22:45:01.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
962025-01-13T22:45:01.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
972025-01-13T22:45:01.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
982025-01-13T22:45:01.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
992025-01-13T22:45:01.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1002025-01-13T22:45:01.105ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2760, tv_nsec: 726883136 } })
1012025-01-13T22:45:01.105ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
1022025-01-13T22:45:01.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1032025-01-13T22:45:01.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1042025-01-13T22:45:01.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1052025-01-13T22:45:01.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
1062025-01-13T22:45:01.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1072025-01-13T22:45:01.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1082025-01-13T22:45:01.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.661279ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
1092025-01-13T22:45:01.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1102025-01-13T22:45:01.130ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
1112025-01-13T22:45:01.130ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.460554ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
1122025-01-13T22:45:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1132025-01-13T22:45:01.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1142025-01-13T22:45:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1152025-01-13T22:45:01.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1162025-01-13T22:45:01.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1172025-01-13T22:45:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1182025-01-13T22:45:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1192025-01-13T22:45:01.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1202025-01-13T22:45:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1212025-01-13T22:45:01.135ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1222025-01-13T22:45:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1232025-01-13T22:45:01.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.411551ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1242025-01-13T22:45:01.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.460912ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1252025-01-13T22:45:01.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1262025-01-13T22:45:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1272025-01-13T22:45:01.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.742973ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1282025-01-13T22:45:01.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1292025-01-13T22:45:01.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1302025-01-13T22:45:01.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
1312025-01-13T22:45:01.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1322025-01-13T22:45:01.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1332025-01-13T22:45:01.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1342025-01-13T22:45:01.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352025-01-13T22:45:01.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1362025-01-13T22:45:01.149ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.275858ms iteration = 4 status = 0
1372025-01-13T22:45:01.151ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1382025-01-13T22:45:01.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1392025-01-13T22:45:01.153ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1402025-01-13T22:45:01.153ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1412025-01-13T22:45:01.153ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1422025-01-13T22:45:01.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1432025-01-13T22:45:01.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1442025-01-13T22:45:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1452025-01-13T22:45:01.155ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1462025-01-13T22:45:01.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1472025-01-13T22:45:01.156ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1482025-01-13T22:45:01.156ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.696879ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1492025-01-13T22:45:01.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1502025-01-13T22:45:01.171ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1512025-01-13T22:45:01.172ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a09a25cd-ff35-4ef6-8727-c4af40b06cc9", "content-length": "26", "date": "Mon, 13 Jan 2025 22:45:01 GMT"} })
1522025-01-13T22:45:01.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1532025-01-13T22:45:01.174ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1542025-01-13T22:45:01.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.459355ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
1552025-01-13T22:45:01.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1562025-01-13T22:45:01.185ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1572025-01-13T22:45:01.185ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66da8da7-554e-4286-a523-7a56675bf31a", "content-length": "26", "date": "Mon, 13 Jan 2025 22:45:01 GMT"} })
1582025-01-13T22:45:01.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1592025-01-13T22:45:01.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1602025-01-13T22:45:01.190ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1612025-01-13T22:45:01.190ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1622025-01-13T22:45:01.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1632025-01-13T22:45:01.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1642025-01-13T22:45:01.193ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
1652025-01-13T22:45:01.193ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 119.157977ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
1662025-01-13T22:45:01.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
1672025-01-13T22:45:01.205ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1682025-01-13T22:45:01.205ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6159c7b9-10b1-4ea9-bba9-abe935a596e1", "content-length": "26", "date": "Mon, 13 Jan 2025 22:45:01 GMT"} })
1692025-01-13T22:45:01.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1702025-01-13T22:45:01.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
1712025-01-13T22:45:01.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1722025-01-13T22:45:01.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1732025-01-13T22:45:01.226ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1742025-01-13T22:45:01.226ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1752025-01-13T22:45:01.226ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.219346ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1762025-01-13T22:45:01.257ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.032255ms iteration = 6 status = {"physical_disks_added":0}
1772025-01-13T22:45:01.284ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.118367ms iteration = 4 status = {}
1782025-01-13T22:45:01.293ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1792025-01-13T22:45:01.293ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1802025-01-13T22:45:01.293ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcda3358-d0e8-4c96-ad6c-9aaf3fdfcb94", "content-length": "372", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
1812025-01-13T22:45:01.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1822025-01-13T22:45:01.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1832025-01-13T22:45:01.358ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
1842025-01-13T22:45:01.358ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1852025-01-13T22:45:01.358ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9445f4e1-e204-4bd8-b782-c81703283517", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
1862025-01-13T22:45:01.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1872025-01-13T22:45:01.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1882025-01-13T22:45:01.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1892025-01-13T22:45:01.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1902025-01-13T22:45:01.364ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1912025-01-13T22:45:01.365ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f354eaa3-f54e-482e-8b25-fde312cfd58f", "content-length": "1", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
1922025-01-13T22:45:01.368ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1932025-01-13T22:45:01.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1942025-01-13T22:45:01.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1952025-01-13T22:45:01.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1962025-01-13T22:45:01.370ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 296.167033ms iteration = 4 status = null
1972025-01-13T22:45:01.373ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
1982025-01-13T22:45:01.373ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1992025-01-13T22:45:01.373ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "feabb998-73f5-4e85-b21f-af2c890153dd", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2002025-01-13T22:45:01.374ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.251011ms iteration = 4 status = {}
2012025-01-13T22:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2022025-01-13T22:45:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2032025-01-13T22:45:01.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042025-01-13T22:45:01.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2052025-01-13T22:45:01.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2062025-01-13T22:45:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2072025-01-13T22:45:01.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082025-01-13T22:45:01.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2092025-01-13T22:45:01.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2102025-01-13T22:45:01.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2112025-01-13T22:45:01.467ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2122025-01-13T22:45:01.468ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9f2063e-8eb1-4332-8203-bf19ff7f1ec8", "content-length": "691", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2132025-01-13T22:45:01.468ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2142025-01-13T22:45:01.468ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2152025-01-13T22:45:01.468ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2162025-01-13T22:45:01.469ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 394.406642ms iteration = 4 status = {}
2172025-01-13T22:45:01.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2182025-01-13T22:45:01.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2192025-01-13T22:45:01.472ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
2202025-01-13T22:45:01.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2212025-01-13T22:45:01.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2222025-01-13T22:45:01.482ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2232025-01-13T22:45:01.482ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "640a4c55-21d9-4541-bcd0-77285262257b", "content-length": "134", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2242025-01-13T22:45:01.482ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2252025-01-13T22:45:01.482ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
2262025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2272025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2282025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2292025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2302025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2312025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2322025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2332025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2342025-01-13T22:45:01.483ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
2352025-01-13T22:45:01.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2362025-01-13T22:45:01.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2372025-01-13T22:45:01.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2382025-01-13T22:45:01.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e122b24d-2e49-4bf6-85c3-7f15397cd550", "content-length": "2", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2392025-01-13T22:45:01.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2402025-01-13T22:45:01.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e912026a-8ea6-436f-915e-cedfae71eb85", "content-length": "51", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2412025-01-13T22:45:01.492ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
2422025-01-13T22:45:01.492ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2432025-01-13T22:45:01.727ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "075d2620-f4dd-47dd-a0ca-836caaeeed38", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2442025-01-13T22:45:01.727ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
2452025-01-13T22:45:01.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2462025-01-13T22:45:01.727ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eca6535e-abc3-4acf-8327-ae94d1001893", "content-length": "682", "date": "Mon, 13 Jan 2025 22:45:00 GMT"} })
2472025-01-13T22:45:01.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2482025-01-13T22:45:01.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2492025-01-13T22:45:01.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = a9dcfc03-784b-4714-afbe-cd4254a762a0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2502025-01-13T22:45:01.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = a9dcfc03-784b-4714-afbe-cd4254a762a0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2512025-01-13T22:45:01.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = a9dcfc03-784b-4714-afbe-cd4254a762a0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2522025-01-13T22:45:01.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2532025-01-13T22:45:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2542025-01-13T22:45:01.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2552025-01-13T22:45:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2562025-01-13T22:45:01.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2572025-01-13T22:45:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2582025-01-13T22:45:01.857ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 782.92328ms iteration = 4 status = {}
2592025-01-13T22:45:02.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a993a5c0-2533-4333-aa32-270ec324e741 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2602025-01-13T22:45:02.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a993a5c0-2533-4333-aa32-270ec324e741 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2612025-01-13T22:45:02.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a993a5c0-2533-4333-aa32-270ec324e741 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2622025-01-13T22:45:03.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1c2fd1-afc1-4eca-b47a-ca123c2bf01f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2632025-01-13T22:45:03.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1c2fd1-afc1-4eca-b47a-ca123c2bf01f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2642025-01-13T22:45:03.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1c2fd1-afc1-4eca-b47a-ca123c2bf01f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2652025-01-13T22:45:03.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = d5c5281d-04c2-48ba-b510-216a457851b8 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
2662025-01-13T22:45:04.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 58e094d8-34bd-46c2-879a-4d3075cab165 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2672025-01-13T22:45:04.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 58e094d8-34bd-46c2-879a-4d3075cab165 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2682025-01-13T22:45:04.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 58e094d8-34bd-46c2-879a-4d3075cab165 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2692025-01-13T22:45:05.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b01203b4-5c04-4a11-b714-e07b7c1c1984 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2702025-01-13T22:45:05.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b01203b4-5c04-4a11-b714-e07b7c1c1984 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2712025-01-13T22:45:05.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b01203b4-5c04-4a11-b714-e07b7c1c1984 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2722025-01-13T22:45:06.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05cdd16d-a549-49bc-944e-e61cb7f850bc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2732025-01-13T22:45:06.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05cdd16d-a549-49bc-944e-e61cb7f850bc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2742025-01-13T22:45:06.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05cdd16d-a549-49bc-944e-e61cb7f850bc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2752025-01-13T22:45:07.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c03dcc3d-8ebd-4e70-8763-9594ff12317a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2762025-01-13T22:45:07.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c03dcc3d-8ebd-4e70-8763-9594ff12317a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2772025-01-13T22:45:07.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c03dcc3d-8ebd-4e70-8763-9594ff12317a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2782025-01-13T22:45:08.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d3c956ad-2f60-4f18-be39-908cc8403182 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2792025-01-13T22:45:08.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d3c956ad-2f60-4f18-be39-908cc8403182 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2802025-01-13T22:45:08.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d3c956ad-2f60-4f18-be39-908cc8403182 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2812025-01-13T22:45:09.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b30cb838-290a-433b-bba8-02ac113120a1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2822025-01-13T22:45:09.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b30cb838-290a-433b-bba8-02ac113120a1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2832025-01-13T22:45:09.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b30cb838-290a-433b-bba8-02ac113120a1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2842025-01-13T22:45:10.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce2ef2cb-6c73-489d-a0fa-99ec0d95bd52 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2852025-01-13T22:45:10.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce2ef2cb-6c73-489d-a0fa-99ec0d95bd52 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2862025-01-13T22:45:10.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce2ef2cb-6c73-489d-a0fa-99ec0d95bd52 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
2872025-01-13T22:45:11.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
2882025-01-13T22:45:11.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
2892025-01-13T22:45:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2902025-01-13T22:45:11.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2912025-01-13T22:45:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2922025-01-13T22:45:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2932025-01-13T22:45:11.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2942025-01-13T22:45:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2952025-01-13T22:45:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2962025-01-13T22:45:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2972025-01-13T22:45:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2982025-01-13T22:45:11.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2992025-01-13T22:45:11.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3002025-01-13T22:45:11.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
3012025-01-13T22:45:11.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3022025-01-13T22:45:11.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3032025-01-13T22:45:11.097ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
3042025-01-13T22:45:11.097ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.576471ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
3052025-01-13T22:45:11.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3062025-01-13T22:45:11.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3072025-01-13T22:45:11.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.105259ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3082025-01-13T22:45:11.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 78fdb2c2-35f7-469a-9896-17a2059e1d67 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3092025-01-13T22:45:11.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 78fdb2c2-35f7-469a-9896-17a2059e1d67 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3102025-01-13T22:45:11.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 78fdb2c2-35f7-469a-9896-17a2059e1d67 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3112025-01-13T22:45:12.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 034c366d-8d04-49bb-be63-89d90b40a453 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3122025-01-13T22:45:12.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 034c366d-8d04-49bb-be63-89d90b40a453 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3132025-01-13T22:45:12.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 034c366d-8d04-49bb-be63-89d90b40a453 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3142025-01-13T22:45:13.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1a394648-5b3e-49ad-bc4f-686b8d11880a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3152025-01-13T22:45:13.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1a394648-5b3e-49ad-bc4f-686b8d11880a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3162025-01-13T22:45:13.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1a394648-5b3e-49ad-bc4f-686b8d11880a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3172025-01-13T22:45:13.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 6517245f-a4ff-471b-a3fe-f5b63fd0dc3f response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
3182025-01-13T22:45:14.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e8ca7007-4b4f-4ee2-b65c-b1886c03dc45 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3192025-01-13T22:45:14.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e8ca7007-4b4f-4ee2-b65c-b1886c03dc45 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3202025-01-13T22:45:14.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e8ca7007-4b4f-4ee2-b65c-b1886c03dc45 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3212025-01-13T22:45:15.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e579f76b-27b5-4aef-89ee-7a5d1ab2003b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3222025-01-13T22:45:15.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e579f76b-27b5-4aef-89ee-7a5d1ab2003b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3232025-01-13T22:45:15.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e579f76b-27b5-4aef-89ee-7a5d1ab2003b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3242025-01-13T22:45:16.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 81eebf85-7a5f-4173-b265-3327a74d9562 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3252025-01-13T22:45:16.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 81eebf85-7a5f-4173-b265-3327a74d9562 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3262025-01-13T22:45:16.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 81eebf85-7a5f-4173-b265-3327a74d9562 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3272025-01-13T22:45:17.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 28157225-2bc9-4d60-a734-a770f8b4bb5a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3282025-01-13T22:45:17.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 28157225-2bc9-4d60-a734-a770f8b4bb5a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3292025-01-13T22:45:17.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 28157225-2bc9-4d60-a734-a770f8b4bb5a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3302025-01-13T22:45:18.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ddbd4ca-c375-4b8b-b8f2-afdcd1411520 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3312025-01-13T22:45:18.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ddbd4ca-c375-4b8b-b8f2-afdcd1411520 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3322025-01-13T22:45:18.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ddbd4ca-c375-4b8b-b8f2-afdcd1411520 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3332025-01-13T22:45:19.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8e7c7a58-757a-4353-9948-5aa43d1a43c3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3342025-01-13T22:45:19.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8e7c7a58-757a-4353-9948-5aa43d1a43c3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3352025-01-13T22:45:19.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8e7c7a58-757a-4353-9948-5aa43d1a43c3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3362025-01-13T22:45:20.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c19cb943-1af9-4271-b67d-3fbd8f101301 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3372025-01-13T22:45:20.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c19cb943-1af9-4271-b67d-3fbd8f101301 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3382025-01-13T22:45:20.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c19cb943-1af9-4271-b67d-3fbd8f101301 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3392025-01-13T22:45:21.074ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
3402025-01-13T22:45:21.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3412025-01-13T22:45:21.074ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
3422025-01-13T22:45:21.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3432025-01-13T22:45:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3442025-01-13T22:45:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3452025-01-13T22:45:21.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3462025-01-13T22:45:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3472025-01-13T22:45:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3482025-01-13T22:45:21.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.628614ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3492025-01-13T22:45:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3502025-01-13T22:45:21.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3512025-01-13T22:45:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3522025-01-13T22:45:21.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3532025-01-13T22:45:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3542025-01-13T22:45:21.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3552025-01-13T22:45:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
3562025-01-13T22:45:21.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3572025-01-13T22:45:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3582025-01-13T22:45:21.097ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
3592025-01-13T22:45:21.097ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.804479ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
3602025-01-13T22:45:21.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a9e9de5-5147-4dcc-bea6-85242fe06450 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3612025-01-13T22:45:21.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a9e9de5-5147-4dcc-bea6-85242fe06450 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3622025-01-13T22:45:21.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a9e9de5-5147-4dcc-bea6-85242fe06450 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3632025-01-13T22:45:22.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 47536c4d-853f-41a5-b795-29b4a69489af roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3642025-01-13T22:45:22.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 47536c4d-853f-41a5-b795-29b4a69489af resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3652025-01-13T22:45:22.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 47536c4d-853f-41a5-b795-29b4a69489af response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3662025-01-13T22:45:23.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 490cde39-6903-43c3-8afb-bfe692848991 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
3672025-01-13T22:45:23.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67f2bc90-527e-4a62-a7cb-1244c5ffb78a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3682025-01-13T22:45:23.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67f2bc90-527e-4a62-a7cb-1244c5ffb78a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3692025-01-13T22:45:23.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67f2bc90-527e-4a62-a7cb-1244c5ffb78a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3702025-01-13T22:45:24.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94ac7fca-32c2-41a3-b3e8-72200e4eddc0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3712025-01-13T22:45:24.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94ac7fca-32c2-41a3-b3e8-72200e4eddc0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3722025-01-13T22:45:24.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94ac7fca-32c2-41a3-b3e8-72200e4eddc0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3732025-01-13T22:45:25.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = deb087f3-60d8-4cd3-bf15-8fa27b47f653 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3742025-01-13T22:45:25.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = deb087f3-60d8-4cd3-bf15-8fa27b47f653 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3752025-01-13T22:45:25.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = deb087f3-60d8-4cd3-bf15-8fa27b47f653 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3762025-01-13T22:45:26.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fe02b228-758d-4dad-9388-310562fab4b3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3772025-01-13T22:45:26.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fe02b228-758d-4dad-9388-310562fab4b3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3782025-01-13T22:45:26.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fe02b228-758d-4dad-9388-310562fab4b3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3792025-01-13T22:45:27.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 832e6682-900e-4041-b5b9-d120e8fb301d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3802025-01-13T22:45:27.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 832e6682-900e-4041-b5b9-d120e8fb301d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3812025-01-13T22:45:27.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 832e6682-900e-4041-b5b9-d120e8fb301d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3822025-01-13T22:45:28.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7e78e488-7187-463f-aacb-b6167db71402 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3832025-01-13T22:45:28.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7e78e488-7187-463f-aacb-b6167db71402 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3842025-01-13T22:45:28.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7e78e488-7187-463f-aacb-b6167db71402 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3852025-01-13T22:45:29.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0be278a9-e9be-49c0-b440-b3083123eedd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3862025-01-13T22:45:29.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0be278a9-e9be-49c0-b440-b3083123eedd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3872025-01-13T22:45:29.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0be278a9-e9be-49c0-b440-b3083123eedd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3882025-01-13T22:45:30.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68902556-ffd6-4df3-8863-28f58d357317 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3892025-01-13T22:45:30.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68902556-ffd6-4df3-8863-28f58d357317 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3902025-01-13T22:45:30.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68902556-ffd6-4df3-8863-28f58d357317 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
3912025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
3922025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
3932025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3942025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
3952025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
3962025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3972025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3982025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
3992025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4002025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
4012025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4022025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
4032025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4042025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4052025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4062025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
4072025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
4082025-01-13T22:45:31.073ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4092025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4102025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
4112025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4122025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4132025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
4142025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4152025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
4162025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
4172025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4182025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4192025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
4202025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4212025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
4222025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4232025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
4242025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4252025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
4262025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4272025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
4282025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4292025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
4302025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
4312025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
4322025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4332025-01-13T22:45:31.073ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:35:31.073799069 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4342025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
4352025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4362025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4372025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4382025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
4392025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4402025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
4412025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4422025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
4432025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4442025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
4452025-01-13T22:45:31.073ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4462025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4472025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
4482025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4492025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
4502025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4512025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
4522025-01-13T22:45:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4532025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
4542025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4552025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
4562025-01-13T22:45:31.074ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
4572025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4582025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.221\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
4592025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4602025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4612025-01-13T22:45:31.074ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2790, tv_nsec: 695928362 } })
4622025-01-13T22:45:31.074ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2790, tv_nsec: 695933542 } })
4632025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4642025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4652025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4662025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4672025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4682025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4692025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4702025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4712025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4722025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4732025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4742025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4752025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4762025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4772025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4782025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4792025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4802025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4812025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
4822025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.497987ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4832025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4842025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4852025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
4862025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.574209ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4872025-01-13T22:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4882025-01-13T22:45:31.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4892025-01-13T22:45:31.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4902025-01-13T22:45:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4912025-01-13T22:45:31.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4922025-01-13T22:45:31.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4932025-01-13T22:45:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4942025-01-13T22:45:31.077ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4952025-01-13T22:45:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4962025-01-13T22:45:31.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972025-01-13T22:45:31.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982025-01-13T22:45:31.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4992025-01-13T22:45:31.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5002025-01-13T22:45:31.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012025-01-13T22:45:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5022025-01-13T22:45:31.080ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.749233ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5032025-01-13T22:45:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5042025-01-13T22:45:31.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5052025-01-13T22:45:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5062025-01-13T22:45:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5072025-01-13T22:45:31.082ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5082025-01-13T22:45:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5092025-01-13T22:45:31.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2790, tv_nsec: 704514732 } })
5102025-01-13T22:45:31.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5112025-01-13T22:45:31.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5122025-01-13T22:45:31.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5132025-01-13T22:45:31.084ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.932854ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
5142025-01-13T22:45:31.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2790, tv_nsec: 707590019 } })
5152025-01-13T22:45:31.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5162025-01-13T22:45:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5172025-01-13T22:45:31.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5182025-01-13T22:45:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5192025-01-13T22:45:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5202025-01-13T22:45:31.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5212025-01-13T22:45:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5222025-01-13T22:45:31.090ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:35:31.073799069 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5232025-01-13T22:45:31.090ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.497229ms iteration = 3 status = {"expiration":"2025-01-13T22:35:31.073799069Z","pruned":[]}
5242025-01-13T22:45:31.091ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5252025-01-13T22:45:31.091ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5262025-01-13T22:45:31.091ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.12623ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5272025-01-13T22:45:31.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5282025-01-13T22:45:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5292025-01-13T22:45:31.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5302025-01-13T22:45:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5312025-01-13T22:45:31.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322025-01-13T22:45:31.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.627455ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
5332025-01-13T22:45:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5342025-01-13T22:45:31.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5352025-01-13T22:45:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5362025-01-13T22:45:31.136ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372025-01-13T22:45:31.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5382025-01-13T22:45:31.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5392025-01-13T22:45:31.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402025-01-13T22:45:31.138ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5412025-01-13T22:45:31.138ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5422025-01-13T22:45:31.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5432025-01-13T22:45:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5442025-01-13T22:45:31.139ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5452025-01-13T22:45:31.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5462025-01-13T22:45:31.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5472025-01-13T22:45:31.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482025-01-13T22:45:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5492025-01-13T22:45:31.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5502025-01-13T22:45:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5512025-01-13T22:45:31.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522025-01-13T22:45:31.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.499103ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
5532025-01-13T22:45:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5542025-01-13T22:45:31.142ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5552025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5562025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5572025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5582025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5592025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5602025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5612025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5622025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5642025-01-13T22:45:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5652025-01-13T22:45:31.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5662025-01-13T22:45:31.144ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
5672025-01-13T22:45:31.144ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
5682025-01-13T22:45:31.144ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
5692025-01-13T22:45:31.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5702025-01-13T22:45:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5712025-01-13T22:45:31.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5722025-01-13T22:45:31.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5732025-01-13T22:45:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5742025-01-13T22:45:31.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.696947ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5752025-01-13T22:45:31.147ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5762025-01-13T22:45:31.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.300776ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5772025-01-13T22:45:31.147ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5782025-01-13T22:45:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5792025-01-13T22:45:31.148ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5802025-01-13T22:45:31.148ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5812025-01-13T22:45:31.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5822025-01-13T22:45:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5832025-01-13T22:45:31.150ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5842025-01-13T22:45:31.150ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2790, tv_nsec: 772216011 } })
5852025-01-13T22:45:31.150ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
5862025-01-13T22:45:31.153ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5872025-01-13T22:45:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5882025-01-13T22:45:31.153ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5892025-01-13T22:45:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5902025-01-13T22:45:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5912025-01-13T22:45:31.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.366836ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5922025-01-13T22:45:31.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5932025-01-13T22:45:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5942025-01-13T22:45:31.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5952025-01-13T22:45:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5962025-01-13T22:45:31.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972025-01-13T22:45:31.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
5982025-01-13T22:45:31.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5992025-01-13T22:45:31.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6002025-01-13T22:45:31.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6012025-01-13T22:45:31.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6022025-01-13T22:45:31.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6032025-01-13T22:45:31.180ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.756257ms iteration = 5 status = 0
6042025-01-13T22:45:31.185ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6052025-01-13T22:45:31.185ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6062025-01-13T22:45:31.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.669392ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6072025-01-13T22:45:31.186ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6082025-01-13T22:45:31.186ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6092025-01-13T22:45:31.186ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.136376ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6102025-01-13T22:45:31.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112025-01-13T22:45:31.191ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6122025-01-13T22:45:31.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6132025-01-13T22:45:31.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
6142025-01-13T22:45:31.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6152025-01-13T22:45:31.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6162025-01-13T22:45:31.195ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6172025-01-13T22:45:31.195ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6182025-01-13T22:45:31.195ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6192025-01-13T22:45:31.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6202025-01-13T22:45:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6212025-01-13T22:45:31.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222025-01-13T22:45:31.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6232025-01-13T22:45:31.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6242025-01-13T22:45:31.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6252025-01-13T22:45:31.197ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.959268ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6262025-01-13T22:45:31.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6272025-01-13T22:45:31.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6282025-01-13T22:45:31.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6292025-01-13T22:45:31.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6302025-01-13T22:45:31.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6312025-01-13T22:45:31.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6322025-01-13T22:45:31.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6332025-01-13T22:45:31.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6352025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6362025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6372025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6382025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
6392025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.513822ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
6402025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6412025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6422025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6432025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6442025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6452025-01-13T22:45:31.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6462025-01-13T22:45:31.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6472025-01-13T22:45:31.204ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6482025-01-13T22:45:31.205ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "add5845b-c4c6-4a24-a177-b4d7b4ddb65c", "content-length": "26", "date": "Mon, 13 Jan 2025 22:45:30 GMT"} })
6492025-01-13T22:45:31.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6502025-01-13T22:45:31.205ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
6512025-01-13T22:45:31.205ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.458733ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
6522025-01-13T22:45:31.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532025-01-13T22:45:31.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6542025-01-13T22:45:31.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6552025-01-13T22:45:31.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6562025-01-13T22:45:31.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6572025-01-13T22:45:31.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6582025-01-13T22:45:31.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6592025-01-13T22:45:31.211ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
6602025-01-13T22:45:31.211ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
6612025-01-13T22:45:31.212ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
6622025-01-13T22:45:31.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 138.821745ms iteration = 3 status = {"generation":1}
6632025-01-13T22:45:31.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.34038ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6642025-01-13T22:45:31.234ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6652025-01-13T22:45:31.234ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
6662025-01-13T22:45:31.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6672025-01-13T22:45:31.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6682025-01-13T22:45:31.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692025-01-13T22:45:31.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6702025-01-13T22:45:31.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6712025-01-13T22:45:31.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6722025-01-13T22:45:31.241ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
6732025-01-13T22:45:31.241ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
6742025-01-13T22:45:31.241ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
6752025-01-13T22:45:31.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 168.036863ms iteration = 3 status = {"generation":2}
6762025-01-13T22:45:31.246ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
6772025-01-13T22:45:31.246ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 173.871868ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
6782025-01-13T22:45:31.253ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6792025-01-13T22:45:31.253ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6802025-01-13T22:45:31.253ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd06aba9-7e65-4b16-b431-960d7f66e1ca", "content-length": "26", "date": "Mon, 13 Jan 2025 22:45:30 GMT"} })
6812025-01-13T22:45:31.253ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6822025-01-13T22:45:31.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6832025-01-13T22:45:31.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6842025-01-13T22:45:31.291ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6852025-01-13T22:45:31.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 217.378086ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6862025-01-13T22:45:31.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6872025-01-13T22:45:31.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6882025-01-13T22:45:31.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892025-01-13T22:45:31.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6902025-01-13T22:45:31.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6912025-01-13T22:45:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6922025-01-13T22:45:31.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6932025-01-13T22:45:31.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6942025-01-13T22:45:31.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6952025-01-13T22:45:31.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6962025-01-13T22:45:31.368ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.431198ms iteration = 5 status = {}
6972025-01-13T22:45:31.415ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 341.721465ms iteration = 7 status = {"physical_disks_added":0}
6982025-01-13T22:45:31.449ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
6992025-01-13T22:45:31.449ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7002025-01-13T22:45:31.449ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89f7e400-b518-4ee8-ad4b-66bfe6fcb1a9", "content-length": "26", "date": "Mon, 13 Jan 2025 22:45:30 GMT"} })
7012025-01-13T22:45:31.449ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7022025-01-13T22:45:31.450ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7032025-01-13T22:45:31.451ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
7042025-01-13T22:45:31.568ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7052025-01-13T22:45:31.568ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7062025-01-13T22:45:31.569ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd42e994-bff3-4139-9ecf-2957326b1b54", "content-length": "372", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7072025-01-13T22:45:31.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7082025-01-13T22:45:31.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7092025-01-13T22:45:31.608ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7102025-01-13T22:45:31.608ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7112025-01-13T22:45:31.608ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5ebd27f2-1edc-4588-9eff-ddc3e1ba6b92", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7122025-01-13T22:45:31.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7132025-01-13T22:45:31.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7142025-01-13T22:45:31.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7152025-01-13T22:45:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7162025-01-13T22:45:31.619ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7172025-01-13T22:45:31.619ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b24ccc3e-d181-4617-a81a-556e6aa5b210", "content-length": "1", "date": "Mon, 13 Jan 2025 22:45:30 GMT"} })
7182025-01-13T22:45:31.620ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7192025-01-13T22:45:31.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7202025-01-13T22:45:31.629ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7212025-01-13T22:45:31.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "93760d52-30b5-4a60-a3bf-6a9d8f5e3f9d", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7222025-01-13T22:45:31.630ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7232025-01-13T22:45:31.631ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "35ea8b81-0508-40b1-b194-e60f629d5238", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7242025-01-13T22:45:31.631ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7252025-01-13T22:45:31.632ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7262025-01-13T22:45:31.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 559.223235ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7272025-01-13T22:45:31.644ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7282025-01-13T22:45:31.644ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e6c4f87-aba6-46a5-afa6-e117f959826b", "content-length": "691", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7292025-01-13T22:45:31.644ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7302025-01-13T22:45:31.644ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7312025-01-13T22:45:31.644ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7322025-01-13T22:45:31.646ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 572.939746ms iteration = 5 status = {}
7332025-01-13T22:45:31.646ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 572.803762ms iteration = 5 status = null
7342025-01-13T22:45:31.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7352025-01-13T22:45:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7362025-01-13T22:45:31.647ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7372025-01-13T22:45:31.648ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a498640c-b653-4c1f-90b5-e1c64a0b24f8", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7382025-01-13T22:45:31.648ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7392025-01-13T22:45:31.649ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a1fd9320-f008-48ee-870a-2e48df2a88bf", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7402025-01-13T22:45:31.649ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7412025-01-13T22:45:31.650ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7422025-01-13T22:45:31.650ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7432025-01-13T22:45:31.650ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a4e1ce55-6fa8-4b93-bf4a-b416b0ac49c9", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7442025-01-13T22:45:31.650ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "012d6630-a65e-41fd-b538-02ae85241e7e", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7452025-01-13T22:45:31.650ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7462025-01-13T22:45:31.652ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 578.76448ms iteration = 5 status = {}
7472025-01-13T22:45:31.652ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
7482025-01-13T22:45:31.652ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 579.561405ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7492025-01-13T22:45:31.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7502025-01-13T22:45:31.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7512025-01-13T22:45:31.719ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
7522025-01-13T22:45:31.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7532025-01-13T22:45:31.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7542025-01-13T22:45:31.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7552025-01-13T22:45:31.729ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cae64525-c820-42e8-8661-93849b7b5c91", "content-length": "134", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7562025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7572025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
7582025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7592025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7602025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7612025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7622025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7632025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7642025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7652025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7662025-01-13T22:45:31.729ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
7672025-01-13T22:45:31.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7682025-01-13T22:45:31.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7692025-01-13T22:45:31.731ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7702025-01-13T22:45:31.731ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e84068c-da4f-4d4a-bf92-999660a9bc99", "content-length": "2", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7712025-01-13T22:45:31.731ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7722025-01-13T22:45:31.731ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b17b822-e0cd-4965-8a15-c094fca3ce96", "content-length": "51", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7732025-01-13T22:45:31.731ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
7742025-01-13T22:45:31.731ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7752025-01-13T22:45:31.815ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f70cca11-4e36-40f0-89c5-66715ae77aed", "date": "Mon, 13 Jan 2025 22:45:31 GMT"} })
7762025-01-13T22:45:31.815ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
7772025-01-13T22:45:31.815ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7782025-01-13T22:45:31.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41ee0f61-2096-4e41-9920-c1afd59fc75b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7792025-01-13T22:45:31.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41ee0f61-2096-4e41-9920-c1afd59fc75b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7802025-01-13T22:45:31.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e5c5e06-c424-436d-8fa8-55ca5362bfaa", "content-length": "682", "date": "Mon, 13 Jan 2025 22:45:30 GMT"} })
7812025-01-13T22:45:31.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7822025-01-13T22:45:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7832025-01-13T22:45:31.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 149161df-9e4c-4099-b30d-90ae3f9a8683 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7842025-01-13T22:45:31.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 149161df-9e4c-4099-b30d-90ae3f9a8683 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7852025-01-13T22:45:31.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41ee0f61-2096-4e41-9920-c1afd59fc75b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7862025-01-13T22:45:31.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7872025-01-13T22:45:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7882025-01-13T22:45:31.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 149161df-9e4c-4099-b30d-90ae3f9a8683 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7892025-01-13T22:45:31.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7902025-01-13T22:45:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7912025-01-13T22:45:31.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7922025-01-13T22:45:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7932025-01-13T22:45:31.831ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 757.454429ms iteration = 5 status = {}
7942025-01-13T22:45:32.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9aa6d6a0-789c-4015-8dc9-2da6d07ae4aa roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7952025-01-13T22:45:32.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9aa6d6a0-789c-4015-8dc9-2da6d07ae4aa resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7962025-01-13T22:45:32.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9aa6d6a0-789c-4015-8dc9-2da6d07ae4aa response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7972025-01-13T22:45:33.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 621e064d-43c3-494d-9255-5cbff93ece94 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
7982025-01-13T22:45:33.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c69b5f9f-7c46-47f2-b5f3-3cd0ef8d96f0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
7992025-01-13T22:45:33.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c69b5f9f-7c46-47f2-b5f3-3cd0ef8d96f0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8002025-01-13T22:45:33.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c69b5f9f-7c46-47f2-b5f3-3cd0ef8d96f0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8012025-01-13T22:45:34.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1e12c523-0b96-4c13-80fe-7bad20f499d3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8022025-01-13T22:45:34.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1e12c523-0b96-4c13-80fe-7bad20f499d3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8032025-01-13T22:45:34.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1e12c523-0b96-4c13-80fe-7bad20f499d3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8042025-01-13T22:45:35.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5aa98338-6e37-4ede-bb7b-0a571ecd51e4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8052025-01-13T22:45:35.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5aa98338-6e37-4ede-bb7b-0a571ecd51e4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8062025-01-13T22:45:35.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5aa98338-6e37-4ede-bb7b-0a571ecd51e4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8072025-01-13T22:45:36.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ebb3205f-cc43-43be-87c1-c3caac820201 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8082025-01-13T22:45:36.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ebb3205f-cc43-43be-87c1-c3caac820201 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8092025-01-13T22:45:36.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ebb3205f-cc43-43be-87c1-c3caac820201 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8102025-01-13T22:45:37.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 331fa277-45b6-445b-970e-cc0b2805b8e0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8112025-01-13T22:45:37.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 331fa277-45b6-445b-970e-cc0b2805b8e0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8122025-01-13T22:45:37.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 331fa277-45b6-445b-970e-cc0b2805b8e0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8132025-01-13T22:45:38.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f190e7ba-5772-426e-a2ff-28cb016bfe9b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8142025-01-13T22:45:38.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f190e7ba-5772-426e-a2ff-28cb016bfe9b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8152025-01-13T22:45:38.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f190e7ba-5772-426e-a2ff-28cb016bfe9b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8162025-01-13T22:45:39.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4849978-4362-4204-af82-df3b7504834e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8172025-01-13T22:45:39.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4849978-4362-4204-af82-df3b7504834e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8182025-01-13T22:45:39.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4849978-4362-4204-af82-df3b7504834e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8192025-01-13T22:45:41.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc902af9-463c-422e-9c39-7cab9c1b7120 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8202025-01-13T22:45:41.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc902af9-463c-422e-9c39-7cab9c1b7120 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8212025-01-13T22:45:41.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc902af9-463c-422e-9c39-7cab9c1b7120 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8222025-01-13T22:45:41.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
8232025-01-13T22:45:41.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
8242025-01-13T22:45:41.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8252025-01-13T22:45:41.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8262025-01-13T22:45:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8272025-01-13T22:45:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8282025-01-13T22:45:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292025-01-13T22:45:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8302025-01-13T22:45:41.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8312025-01-13T22:45:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8322025-01-13T22:45:41.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8332025-01-13T22:45:41.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8342025-01-13T22:45:41.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352025-01-13T22:45:41.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
8362025-01-13T22:45:41.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8372025-01-13T22:45:41.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8382025-01-13T22:45:41.097ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
8392025-01-13T22:45:41.097ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.23321ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
8402025-01-13T22:45:41.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8412025-01-13T22:45:41.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8422025-01-13T22:45:41.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.941812ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8432025-01-13T22:45:42.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b2f41369-c7d4-4247-bbdf-f2f455903f30 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8442025-01-13T22:45:42.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b2f41369-c7d4-4247-bbdf-f2f455903f30 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8452025-01-13T22:45:42.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b2f41369-c7d4-4247-bbdf-f2f455903f30 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8462025-01-13T22:45:43.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6b4f6738-2cbb-47ec-820b-e0bececcf9c8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8472025-01-13T22:45:43.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6b4f6738-2cbb-47ec-820b-e0bececcf9c8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8482025-01-13T22:45:43.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6b4f6738-2cbb-47ec-820b-e0bececcf9c8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8492025-01-13T22:45:43.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 477 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = ccb3f568-638f-4384-bb17-22adaa65d8f5 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
8502025-01-13T22:45:44.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a5534eb3-4453-4f49-803b-92c0fbeb0b6f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8512025-01-13T22:45:44.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a5534eb3-4453-4f49-803b-92c0fbeb0b6f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8522025-01-13T22:45:44.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a5534eb3-4453-4f49-803b-92c0fbeb0b6f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8532025-01-13T22:45:45.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a22500be-d97c-43b7-abda-f01cfa3a800c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8542025-01-13T22:45:45.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a22500be-d97c-43b7-abda-f01cfa3a800c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8552025-01-13T22:45:45.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a22500be-d97c-43b7-abda-f01cfa3a800c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8562025-01-13T22:45:46.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3b159ed9-21b0-49e3-9903-c351a94d624c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8572025-01-13T22:45:46.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3b159ed9-21b0-49e3-9903-c351a94d624c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8582025-01-13T22:45:46.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3b159ed9-21b0-49e3-9903-c351a94d624c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8592025-01-13T22:45:47.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a20ae2fd-c1d7-4d54-abdf-37143de2901c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8602025-01-13T22:45:47.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a20ae2fd-c1d7-4d54-abdf-37143de2901c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8612025-01-13T22:45:47.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a20ae2fd-c1d7-4d54-abdf-37143de2901c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8622025-01-13T22:45:48.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f27ef357-a264-44fe-9e81-8d53454185e4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8632025-01-13T22:45:48.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f27ef357-a264-44fe-9e81-8d53454185e4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8642025-01-13T22:45:48.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f27ef357-a264-44fe-9e81-8d53454185e4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8652025-01-13T22:45:49.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a1747dc-8ece-4d8c-b68b-384d16014e1b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8662025-01-13T22:45:49.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a1747dc-8ece-4d8c-b68b-384d16014e1b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8672025-01-13T22:45:49.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a1747dc-8ece-4d8c-b68b-384d16014e1b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8682025-01-13T22:45:50.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f5c1c076-7ad3-4b32-af0b-350202addc66 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8692025-01-13T22:45:50.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f5c1c076-7ad3-4b32-af0b-350202addc66 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8702025-01-13T22:45:50.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f5c1c076-7ad3-4b32-af0b-350202addc66 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8712025-01-13T22:45:51.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
8722025-01-13T22:45:51.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
8732025-01-13T22:45:51.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8742025-01-13T22:45:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8752025-01-13T22:45:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8762025-01-13T22:45:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8772025-01-13T22:45:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782025-01-13T22:45:51.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8792025-01-13T22:45:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8802025-01-13T22:45:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8812025-01-13T22:45:51.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8822025-01-13T22:45:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8832025-01-13T22:45:51.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8842025-01-13T22:45:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852025-01-13T22:45:51.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862025-01-13T22:45:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
8872025-01-13T22:45:51.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8882025-01-13T22:45:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8892025-01-13T22:45:51.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
8902025-01-13T22:45:51.095ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.523719ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
8912025-01-13T22:45:51.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.442098ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8922025-01-13T22:45:51.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59b4103f-039b-4288-af5b-711bbc65d46d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8932025-01-13T22:45:51.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59b4103f-039b-4288-af5b-711bbc65d46d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8942025-01-13T22:45:51.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59b4103f-039b-4288-af5b-711bbc65d46d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8952025-01-13T22:45:52.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 06f7de6e-5cb5-485b-bc59-401892e884d9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8962025-01-13T22:45:52.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 06f7de6e-5cb5-485b-bc59-401892e884d9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8972025-01-13T22:45:52.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 06f7de6e-5cb5-485b-bc59-401892e884d9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8982025-01-13T22:45:53.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36358396-299d-47c9-926a-294495966085 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
8992025-01-13T22:45:53.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36358396-299d-47c9-926a-294495966085 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9002025-01-13T22:45:53.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36358396-299d-47c9-926a-294495966085 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9012025-01-13T22:45:53.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 566 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = c7711b36-52f4-44eb-9486-c0a8f0cc23e3 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
9022025-01-13T22:45:54.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6c45bbfc-a675-4b03-ad55-59d99acb164a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9032025-01-13T22:45:54.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6c45bbfc-a675-4b03-ad55-59d99acb164a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9042025-01-13T22:45:54.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6c45bbfc-a675-4b03-ad55-59d99acb164a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9052025-01-13T22:45:55.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 161fafc3-30f6-4ea1-b690-e12ec545e9bf roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9062025-01-13T22:45:55.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 161fafc3-30f6-4ea1-b690-e12ec545e9bf resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9072025-01-13T22:45:55.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 161fafc3-30f6-4ea1-b690-e12ec545e9bf response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9082025-01-13T22:45:56.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7254ea79-e57a-479b-8696-e2e1980afd1a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9092025-01-13T22:45:56.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7254ea79-e57a-479b-8696-e2e1980afd1a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9102025-01-13T22:45:56.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7254ea79-e57a-479b-8696-e2e1980afd1a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9112025-01-13T22:45:57.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a2375aa3-5c27-4243-be36-a59979475d91 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9122025-01-13T22:45:57.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a2375aa3-5c27-4243-be36-a59979475d91 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9132025-01-13T22:45:57.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a2375aa3-5c27-4243-be36-a59979475d91 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9142025-01-13T22:45:58.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5ed77496-a464-440c-b423-57b96b570cce roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9152025-01-13T22:45:58.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5ed77496-a464-440c-b423-57b96b570cce resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9162025-01-13T22:45:58.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5ed77496-a464-440c-b423-57b96b570cce response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9172025-01-13T22:45:58.504ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:46949
9182025-01-13T22:45:58.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 1affe4b1-edcb-447f-afa2-ea9a62388990 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
9192025-01-13T22:45:58.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 1affe4b1-edcb-447f-afa2-ea9a62388990 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
9202025-01-13T22:45:58.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 1affe4b1-edcb-447f-afa2-ea9a62388990 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
9212025-01-13T22:45:58.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = fc28dcb7-4a94-4ad2-8b51-0cadb673ff76 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
9222025-01-13T22:45:58.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = fc28dcb7-4a94-4ad2-8b51-0cadb673ff76 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
9232025-01-13T22:45:58.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = fc28dcb7-4a94-4ad2-8b51-0cadb673ff76 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
9242025-01-13T22:45:59.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8b23b13-52ed-4f5e-8551-1d83ad245c30 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9252025-01-13T22:45:59.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8b23b13-52ed-4f5e-8551-1d83ad245c30 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9262025-01-13T22:45:59.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8b23b13-52ed-4f5e-8551-1d83ad245c30 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9272025-01-13T22:46:00.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7c99c89b-261c-4500-b462-f90ca6f5b3d2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9282025-01-13T22:46:00.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7c99c89b-261c-4500-b462-f90ca6f5b3d2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9292025-01-13T22:46:00.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7c99c89b-261c-4500-b462-f90ca6f5b3d2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
9302025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
9312025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
9322025-01-13T22:46:01.073ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9332025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9342025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
9352025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9362025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9372025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
9382025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
9392025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9402025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9412025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
9422025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9432025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
9442025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9452025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
9462025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9472025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
9482025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9492025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9502025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
9512025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
9522025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9532025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9542025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
9552025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9562025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
9572025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
9582025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9592025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9602025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
9612025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9622025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
9632025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9642025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
9652025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9662025-01-13T22:46:01.073ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
9672025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9682025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9692025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9702025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9712025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9722025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9732025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9742025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9752025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9762025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9772025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9782025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9792025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9802025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9812025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9822025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9832025-01-13T22:46:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
9842025-01-13T22:46:01.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9852025-01-13T22:46:01.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862025-01-13T22:46:01.077ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2820, tv_nsec: 699676000 } })
9872025-01-13T22:46:01.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9882025-01-13T22:46:01.077ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.005716ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9892025-01-13T22:46:01.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9902025-01-13T22:46:01.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9912025-01-13T22:46:01.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9922025-01-13T22:46:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9932025-01-13T22:46:01.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9942025-01-13T22:46:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9952025-01-13T22:46:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9962025-01-13T22:46:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9972025-01-13T22:46:01.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9982025-01-13T22:46:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9992025-01-13T22:46:01.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002025-01-13T22:46:01.082ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10012025-01-13T22:46:01.082ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10022025-01-13T22:46:01.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10032025-01-13T22:46:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10042025-01-13T22:46:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10052025-01-13T22:46:01.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10062025-01-13T22:46:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10072025-01-13T22:46:01.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10082025-01-13T22:46:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10092025-01-13T22:46:01.086ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2820, tv_nsec: 708540649 } })
10102025-01-13T22:46:01.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10112025-01-13T22:46:01.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10122025-01-13T22:46:01.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132025-01-13T22:46:01.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10142025-01-13T22:46:01.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10152025-01-13T22:46:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10162025-01-13T22:46:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10172025-01-13T22:46:01.090ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10182025-01-13T22:46:01.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10192025-01-13T22:46:01.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10202025-01-13T22:46:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10212025-01-13T22:46:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10222025-01-13T22:46:01.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10232025-01-13T22:46:01.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10242025-01-13T22:46:01.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10252025-01-13T22:46:01.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10262025-01-13T22:46:01.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10272025-01-13T22:46:01.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2820, tv_nsec: 718371568 } })
10282025-01-13T22:46:01.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
10292025-01-13T22:46:01.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10302025-01-13T22:46:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10312025-01-13T22:46:01.118ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10322025-01-13T22:46:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10332025-01-13T22:46:01.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.085882ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
10342025-01-13T22:46:01.128ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10352025-01-13T22:46:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10362025-01-13T22:46:01.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.428935ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10372025-01-13T22:46:01.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.634351ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
10382025-01-13T22:46:01.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392025-01-13T22:46:01.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10402025-01-13T22:46:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10412025-01-13T22:46:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10422025-01-13T22:46:01.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10432025-01-13T22:46:01.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10442025-01-13T22:46:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10452025-01-13T22:46:01.135ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10462025-01-13T22:46:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10472025-01-13T22:46:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10482025-01-13T22:46:01.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10492025-01-13T22:46:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
10502025-01-13T22:46:01.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10512025-01-13T22:46:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10522025-01-13T22:46:01.142ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10532025-01-13T22:46:01.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.127743ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10542025-01-13T22:46:01.144ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10552025-01-13T22:46:01.144ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10562025-01-13T22:46:01.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10572025-01-13T22:46:01.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10582025-01-13T22:46:01.155ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10592025-01-13T22:46:01.155ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10602025-01-13T22:46:01.156ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f8c825-3675-4f68-a694-dedf79bed90f", "content-length": "26", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
10612025-01-13T22:46:01.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10622025-01-13T22:46:01.157ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10632025-01-13T22:46:01.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10642025-01-13T22:46:01.181ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10652025-01-13T22:46:01.181ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5f9d7e9-56e0-4510-a0f6-ef76bd94380c", "content-length": "26", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
10662025-01-13T22:46:01.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10672025-01-13T22:46:01.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10682025-01-13T22:46:01.207ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10692025-01-13T22:46:01.207ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10702025-01-13T22:46:01.207ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e53868d5-ca55-433c-a999-1a2359d37dc7", "content-length": "372", "date": "Mon, 13 Jan 2025 22:46:01 GMT"} })
10712025-01-13T22:46:01.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10722025-01-13T22:46:01.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10732025-01-13T22:46:01.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10742025-01-13T22:46:01.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10752025-01-13T22:46:01.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10762025-01-13T22:46:01.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10772025-01-13T22:46:01.220ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
10782025-01-13T22:46:01.220ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10792025-01-13T22:46:01.221ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c1760b1-0c01-4218-ae57-3cf5855c15fd", "content-length": "26", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
10802025-01-13T22:46:01.221ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10812025-01-13T22:46:01.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10822025-01-13T22:46:01.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
10832025-01-13T22:46:01.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10842025-01-13T22:46:01.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852025-01-13T22:46:01.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10862025-01-13T22:46:01.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10872025-01-13T22:46:01.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10882025-01-13T22:46:01.229ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
10892025-01-13T22:46:01.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 155.85553ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
10902025-01-13T22:46:01.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 167.683852ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10912025-01-13T22:46:01.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 168.465857ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10922025-01-13T22:46:01.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932025-01-13T22:46:01.249ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10942025-01-13T22:46:01.249ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10952025-01-13T22:46:01.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.624722ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10962025-01-13T22:46:01.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10972025-01-13T22:46:01.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10982025-01-13T22:46:01.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10992025-01-13T22:46:01.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11002025-01-13T22:46:01.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11012025-01-13T22:46:01.250ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11022025-01-13T22:46:01.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032025-01-13T22:46:01.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11042025-01-13T22:46:01.253ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11052025-01-13T22:46:01.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11062025-01-13T22:46:01.254ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11072025-01-13T22:46:01.254ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11082025-01-13T22:46:01.255ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "efcf99a5-8651-4476-86eb-1b02e25c5d87", "date": "Mon, 13 Jan 2025 22:46:01 GMT"} })
11092025-01-13T22:46:01.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11102025-01-13T22:46:01.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11112025-01-13T22:46:01.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
11122025-01-13T22:46:01.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11132025-01-13T22:46:01.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11142025-01-13T22:46:01.258ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 185.135822ms iteration = 6 status = 0
11152025-01-13T22:46:01.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11162025-01-13T22:46:01.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11172025-01-13T22:46:01.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11182025-01-13T22:46:01.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11192025-01-13T22:46:01.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202025-01-13T22:46:01.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11212025-01-13T22:46:01.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11222025-01-13T22:46:01.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11232025-01-13T22:46:01.270ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11242025-01-13T22:46:01.270ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11252025-01-13T22:46:01.270ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "643f6492-94c0-4893-83fc-f620dd0ef2a4", "date": "Mon, 13 Jan 2025 22:46:01 GMT"} })
11262025-01-13T22:46:01.270ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11272025-01-13T22:46:01.271ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9143ae1d-98c4-4bf7-b604-4ef718e6bd0c", "content-length": "1", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
11282025-01-13T22:46:01.271ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 198.220992ms iteration = 6 status = {}
11292025-01-13T22:46:01.272ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11302025-01-13T22:46:01.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11312025-01-13T22:46:01.274ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 200.535025ms iteration = 6 status = null
11322025-01-13T22:46:01.277ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 203.952223ms iteration = 6 status = {}
11332025-01-13T22:46:01.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 210.008634ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11342025-01-13T22:46:01.287ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
11352025-01-13T22:46:01.287ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 214.304398ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
11362025-01-13T22:46:01.290ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 216.657242ms iteration = 8 status = {"physical_disks_added":0}
11372025-01-13T22:46:01.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11382025-01-13T22:46:01.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11392025-01-13T22:46:01.352ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
11402025-01-13T22:46:01.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11412025-01-13T22:46:01.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11422025-01-13T22:46:01.361ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11432025-01-13T22:46:01.362ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "172d63d9-2cae-4b8b-a954-a7f9962f554d", "content-length": "691", "date": "Mon, 13 Jan 2025 22:46:01 GMT"} })
11442025-01-13T22:46:01.362ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11452025-01-13T22:46:01.362ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11462025-01-13T22:46:01.362ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11472025-01-13T22:46:01.363ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 290.272038ms iteration = 6 status = {}
11482025-01-13T22:46:01.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5408ae94-83b5-4265-b8dd-da262b874d61 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11492025-01-13T22:46:01.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5408ae94-83b5-4265-b8dd-da262b874d61 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11502025-01-13T22:46:01.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5408ae94-83b5-4265-b8dd-da262b874d61 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11512025-01-13T22:46:01.457ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11522025-01-13T22:46:01.458ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "258eab6d-2a8b-4a5b-b0d4-e4ec7522008a", "content-length": "134", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
11532025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11542025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
11552025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11562025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11572025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11582025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11592025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11602025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11612025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11622025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11632025-01-13T22:46:01.458ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
11642025-01-13T22:46:01.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11652025-01-13T22:46:01.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11662025-01-13T22:46:01.460ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11672025-01-13T22:46:01.460ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8559fd53-ba14-4423-972e-7e584ae484d6", "content-length": "2", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
11682025-01-13T22:46:01.460ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11692025-01-13T22:46:01.460ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "91085409-4b8f-4d7c-8ba4-3479d4b2a5f7", "content-length": "51", "date": "Mon, 13 Jan 2025 22:46:00 GMT"} })
11702025-01-13T22:46:01.460ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
11712025-01-13T22:46:01.460ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11722025-01-13T22:46:01.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3d2843e0-b917-466b-bae4-619722e62a55", "date": "Mon, 13 Jan 2025 22:46:01 GMT"} })
11732025-01-13T22:46:01.548ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
11742025-01-13T22:46:01.548ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11752025-01-13T22:46:01.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f061c728-f566-4ac9-923c-073b9fca2553", "content-length": "682", "date": "Mon, 13 Jan 2025 22:46:01 GMT"} })
11762025-01-13T22:46:01.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11772025-01-13T22:46:01.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11782025-01-13T22:46:01.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11792025-01-13T22:46:01.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11802025-01-13T22:46:01.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11812025-01-13T22:46:01.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11822025-01-13T22:46:01.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11832025-01-13T22:46:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11842025-01-13T22:46:01.564ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 490.968669ms iteration = 6 status = {}
11852025-01-13T22:46:01.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 866adfa3-b1a0-4d12-9871-f7f13ae43b76 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11862025-01-13T22:46:01.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 866adfa3-b1a0-4d12-9871-f7f13ae43b76 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11872025-01-13T22:46:01.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 866adfa3-b1a0-4d12-9871-f7f13ae43b76 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
11882025-01-13T22:46:02.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e8733f2d-f03d-48bc-a631-c260c45096af roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11892025-01-13T22:46:02.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e8733f2d-f03d-48bc-a631-c260c45096af resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11902025-01-13T22:46:02.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e8733f2d-f03d-48bc-a631-c260c45096af response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11912025-01-13T22:46:03.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c7b14539-56cc-43f2-8a53-9e9f74fcc664 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11922025-01-13T22:46:03.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c7b14539-56cc-43f2-8a53-9e9f74fcc664 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11932025-01-13T22:46:03.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c7b14539-56cc-43f2-8a53-9e9f74fcc664 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11942025-01-13T22:46:03.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = a4e2971d-0b13-4628-83c3-99e3e3ce9e13 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
11952025-01-13T22:46:04.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7e6e545b-5dda-4b70-b052-e693841be8a6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11962025-01-13T22:46:04.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7e6e545b-5dda-4b70-b052-e693841be8a6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11972025-01-13T22:46:04.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7e6e545b-5dda-4b70-b052-e693841be8a6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11982025-01-13T22:46:05.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c810a37-ec4b-421e-9c74-847069156171 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
11992025-01-13T22:46:05.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c810a37-ec4b-421e-9c74-847069156171 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12002025-01-13T22:46:05.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c810a37-ec4b-421e-9c74-847069156171 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12012025-01-13T22:46:06.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = db6f2b34-656b-40fb-803d-638635816913 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12022025-01-13T22:46:06.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = db6f2b34-656b-40fb-803d-638635816913 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12032025-01-13T22:46:06.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = db6f2b34-656b-40fb-803d-638635816913 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12042025-01-13T22:46:07.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a4dd085-0f55-4964-9d48-52975e176be7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12052025-01-13T22:46:07.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a4dd085-0f55-4964-9d48-52975e176be7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12062025-01-13T22:46:07.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a4dd085-0f55-4964-9d48-52975e176be7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12072025-01-13T22:46:08.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 271cbe33-79d0-4617-b4eb-c12de07130b7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12082025-01-13T22:46:08.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 271cbe33-79d0-4617-b4eb-c12de07130b7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12092025-01-13T22:46:08.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 271cbe33-79d0-4617-b4eb-c12de07130b7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12102025-01-13T22:46:09.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c21d21e-4a38-4295-acbb-95ed60fd681c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12112025-01-13T22:46:09.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c21d21e-4a38-4295-acbb-95ed60fd681c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12122025-01-13T22:46:09.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c21d21e-4a38-4295-acbb-95ed60fd681c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12132025-01-13T22:46:10.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bdd0e95e-a03b-4ead-ad78-01e3cf5aa9eb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12142025-01-13T22:46:10.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bdd0e95e-a03b-4ead-ad78-01e3cf5aa9eb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12152025-01-13T22:46:10.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bdd0e95e-a03b-4ead-ad78-01e3cf5aa9eb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12162025-01-13T22:46:11.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
12172025-01-13T22:46:11.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
12182025-01-13T22:46:11.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12192025-01-13T22:46:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12202025-01-13T22:46:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12212025-01-13T22:46:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12222025-01-13T22:46:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232025-01-13T22:46:11.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12242025-01-13T22:46:11.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12252025-01-13T22:46:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12262025-01-13T22:46:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12272025-01-13T22:46:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12282025-01-13T22:46:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12292025-01-13T22:46:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12302025-01-13T22:46:11.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312025-01-13T22:46:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
12322025-01-13T22:46:11.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12332025-01-13T22:46:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342025-01-13T22:46:11.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
12352025-01-13T22:46:11.095ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.990641ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
12362025-01-13T22:46:11.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.057579ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12372025-01-13T22:46:11.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 47a16bf3-d0a9-4783-baa1-84f65542e3eb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12382025-01-13T22:46:11.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 47a16bf3-d0a9-4783-baa1-84f65542e3eb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12392025-01-13T22:46:11.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 47a16bf3-d0a9-4783-baa1-84f65542e3eb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12402025-01-13T22:46:12.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7897ff46-717e-4533-adec-ab0acb4c2d28 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12412025-01-13T22:46:12.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7897ff46-717e-4533-adec-ab0acb4c2d28 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12422025-01-13T22:46:12.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7897ff46-717e-4533-adec-ab0acb4c2d28 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12432025-01-13T22:46:13.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = d02e2e62-e548-41c9-b2bb-79ac17a4a969 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
12442025-01-13T22:46:13.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5189e4e1-f84b-4881-bad0-db40fc61a090 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12452025-01-13T22:46:13.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5189e4e1-f84b-4881-bad0-db40fc61a090 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12462025-01-13T22:46:13.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5189e4e1-f84b-4881-bad0-db40fc61a090 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12472025-01-13T22:46:14.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b25ba5b9-134a-496a-aa2b-d92922a6063f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12482025-01-13T22:46:14.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b25ba5b9-134a-496a-aa2b-d92922a6063f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12492025-01-13T22:46:14.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b25ba5b9-134a-496a-aa2b-d92922a6063f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12502025-01-13T22:46:15.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c16f02d8-e741-43c9-a787-edc07ac9a2d6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12512025-01-13T22:46:15.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c16f02d8-e741-43c9-a787-edc07ac9a2d6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12522025-01-13T22:46:15.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c16f02d8-e741-43c9-a787-edc07ac9a2d6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12532025-01-13T22:46:16.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ddd9d5f-a798-492c-a87e-1098c086dc81 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12542025-01-13T22:46:16.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ddd9d5f-a798-492c-a87e-1098c086dc81 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12552025-01-13T22:46:16.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ddd9d5f-a798-492c-a87e-1098c086dc81 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12562025-01-13T22:46:17.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 09b45312-52c6-48f0-a843-0e25381d9400 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12572025-01-13T22:46:17.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 09b45312-52c6-48f0-a843-0e25381d9400 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12582025-01-13T22:46:17.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 09b45312-52c6-48f0-a843-0e25381d9400 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12592025-01-13T22:46:18.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5acaa50f-52d4-4297-8c86-50aae58dd31c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12602025-01-13T22:46:18.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5acaa50f-52d4-4297-8c86-50aae58dd31c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12612025-01-13T22:46:18.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5acaa50f-52d4-4297-8c86-50aae58dd31c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12622025-01-13T22:46:19.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4b4a1b7f-6082-474a-b8db-e9cc98875959 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12632025-01-13T22:46:19.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4b4a1b7f-6082-474a-b8db-e9cc98875959 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12642025-01-13T22:46:19.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4b4a1b7f-6082-474a-b8db-e9cc98875959 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12652025-01-13T22:46:20.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4ffdd11e-e284-48bd-976c-97124e8595c8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12662025-01-13T22:46:20.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4ffdd11e-e284-48bd-976c-97124e8595c8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12672025-01-13T22:46:20.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4ffdd11e-e284-48bd-976c-97124e8595c8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12682025-01-13T22:46:21.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
12692025-01-13T22:46:21.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
12702025-01-13T22:46:21.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12712025-01-13T22:46:21.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12722025-01-13T22:46:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12732025-01-13T22:46:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12742025-01-13T22:46:21.075ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12752025-01-13T22:46:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12762025-01-13T22:46:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12772025-01-13T22:46:21.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.081908ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12782025-01-13T22:46:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12792025-01-13T22:46:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12802025-01-13T22:46:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12812025-01-13T22:46:21.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12822025-01-13T22:46:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12832025-01-13T22:46:21.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12842025-01-13T22:46:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
12852025-01-13T22:46:21.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12862025-01-13T22:46:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12872025-01-13T22:46:21.092ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
12882025-01-13T22:46:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.7213ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
12892025-01-13T22:46:21.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a6a3965e-7653-4a46-b182-289e66616157 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12902025-01-13T22:46:21.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a6a3965e-7653-4a46-b182-289e66616157 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12912025-01-13T22:46:21.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a6a3965e-7653-4a46-b182-289e66616157 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12922025-01-13T22:46:22.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cec30677-6ecc-49be-9034-6bb5c8f389e2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12932025-01-13T22:46:22.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cec30677-6ecc-49be-9034-6bb5c8f389e2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12942025-01-13T22:46:22.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cec30677-6ecc-49be-9034-6bb5c8f389e2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12952025-01-13T22:46:23.512ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 467 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 060752c3-cb94-4ab8-a51a-930b07a01d32 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
12962025-01-13T22:46:23.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4267c349-3bea-4272-ae9d-ddd4fc94065d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12972025-01-13T22:46:23.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4267c349-3bea-4272-ae9d-ddd4fc94065d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12982025-01-13T22:46:23.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4267c349-3bea-4272-ae9d-ddd4fc94065d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
12992025-01-13T22:46:24.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f907ef55-650d-4f94-b71f-5323869a4a21 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13002025-01-13T22:46:24.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f907ef55-650d-4f94-b71f-5323869a4a21 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13012025-01-13T22:46:24.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f907ef55-650d-4f94-b71f-5323869a4a21 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13022025-01-13T22:46:25.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8cb2686d-60a5-4547-96d5-3ae7bc4c852b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13032025-01-13T22:46:25.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8cb2686d-60a5-4547-96d5-3ae7bc4c852b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13042025-01-13T22:46:25.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8cb2686d-60a5-4547-96d5-3ae7bc4c852b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13052025-01-13T22:46:26.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 259d0a4b-6f4b-4917-a20d-bc8843266dbd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13062025-01-13T22:46:26.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 259d0a4b-6f4b-4917-a20d-bc8843266dbd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13072025-01-13T22:46:26.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 259d0a4b-6f4b-4917-a20d-bc8843266dbd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13082025-01-13T22:46:28.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc80f8c0-fbb3-4029-969f-f8ca0bee5168 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13092025-01-13T22:46:28.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc80f8c0-fbb3-4029-969f-f8ca0bee5168 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13102025-01-13T22:46:28.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc80f8c0-fbb3-4029-969f-f8ca0bee5168 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13112025-01-13T22:46:28.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 7c4cb915-c60d-4039-8831-ff7478f2d4d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
13122025-01-13T22:46:28.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 7c4cb915-c60d-4039-8831-ff7478f2d4d3 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
13132025-01-13T22:46:28.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 7c4cb915-c60d-4039-8831-ff7478f2d4d3 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
13142025-01-13T22:46:28.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 77abd721-04a3-4738-abf3-82ca6fd76536 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
13152025-01-13T22:46:28.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 77abd721-04a3-4738-abf3-82ca6fd76536 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
13162025-01-13T22:46:28.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 77abd721-04a3-4738-abf3-82ca6fd76536 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
13172025-01-13T22:46:29.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 91ed73f8-8bae-46ac-a150-9cb5ff4f978a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13182025-01-13T22:46:29.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 91ed73f8-8bae-46ac-a150-9cb5ff4f978a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13192025-01-13T22:46:29.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 91ed73f8-8bae-46ac-a150-9cb5ff4f978a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13202025-01-13T22:46:30.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c61df11a-7d6e-4575-9edb-88147066380a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13212025-01-13T22:46:30.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c61df11a-7d6e-4575-9edb-88147066380a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13222025-01-13T22:46:30.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c61df11a-7d6e-4575-9edb-88147066380a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13232025-01-13T22:46:31.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a635eed-db99-4b62-a9d9-5c5547727be5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13242025-01-13T22:46:31.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a635eed-db99-4b62-a9d9-5c5547727be5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
13252025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
13262025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13272025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
13282025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
13292025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
13302025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
13312025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13322025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13332025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
13342025-01-13T22:46:31.071ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13352025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13362025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
13372025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13382025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13392025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13402025-01-13T22:46:31.072ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2850, tv_nsec: 695089766 } })
13412025-01-13T22:46:31.072ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2850, tv_nsec: 695098486 } })
13422025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
13432025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13442025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
13452025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
13462025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
13472025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13482025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
13492025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13502025-01-13T22:46:31.072ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13512025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13522025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13532025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
13542025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13552025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
13562025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13572025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
13582025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
13592025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13602025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13612025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13622025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
13632025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13642025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
13652025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13662025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
13672025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13682025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
13692025-01-13T22:46:31.072ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:36:31.072871173 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13702025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
13712025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
13722025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13732025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13742025-01-13T22:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13752025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
13762025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13772025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
13782025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13792025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
13802025-01-13T22:46:31.073ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13812025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13822025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
13832025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13842025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
13852025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13862025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
13872025-01-13T22:46:31.073ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
13882025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.151\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
13892025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
13902025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
13912025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13922025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
13932025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13942025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
13952025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13962025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13972025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13982025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13992025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14002025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14012025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.316482ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14022025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14032025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14042025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.273889ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14052025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14062025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14072025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14082025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14092025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14102025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14112025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14122025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14132025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14142025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14152025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14162025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14172025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14182025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14192025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14212025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14222025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14232025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14242025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14252025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14262025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14272025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14282025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14292025-01-13T22:46:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14302025-01-13T22:46:31.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a635eed-db99-4b62-a9d9-5c5547727be5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
14312025-01-13T22:46:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14322025-01-13T22:46:31.074ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14332025-01-13T22:46:31.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14342025-01-13T22:46:31.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352025-01-13T22:46:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14362025-01-13T22:46:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14372025-01-13T22:46:31.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14382025-01-13T22:46:31.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14392025-01-13T22:46:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14402025-01-13T22:46:31.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412025-01-13T22:46:31.077ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.468861ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14422025-01-13T22:46:31.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432025-01-13T22:46:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14442025-01-13T22:46:31.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14452025-01-13T22:46:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14462025-01-13T22:46:31.080ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14472025-01-13T22:46:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14482025-01-13T22:46:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14492025-01-13T22:46:31.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502025-01-13T22:46:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512025-01-13T22:46:31.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2850, tv_nsec: 708039953 } })
14522025-01-13T22:46:31.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14532025-01-13T22:46:31.086ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:36:31.072871173 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14542025-01-13T22:46:31.086ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.541495ms iteration = 4 status = {"expiration":"2025-01-13T22:36:31.072871173Z","pruned":[]}
14552025-01-13T22:46:31.087ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.452775ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
14562025-01-13T22:46:31.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572025-01-13T22:46:31.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582025-01-13T22:46:31.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592025-01-13T22:46:31.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14602025-01-13T22:46:31.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14612025-01-13T22:46:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14622025-01-13T22:46:31.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14632025-01-13T22:46:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14642025-01-13T22:46:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14652025-01-13T22:46:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14662025-01-13T22:46:31.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14672025-01-13T22:46:31.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14682025-01-13T22:46:31.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2850, tv_nsec: 718006296 } })
14692025-01-13T22:46:31.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14702025-01-13T22:46:31.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14712025-01-13T22:46:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14722025-01-13T22:46:31.099ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14732025-01-13T22:46:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14742025-01-13T22:46:31.099ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14752025-01-13T22:46:31.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762025-01-13T22:46:31.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14772025-01-13T22:46:31.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14782025-01-13T22:46:31.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14792025-01-13T22:46:31.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14802025-01-13T22:46:31.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812025-01-13T22:46:31.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14822025-01-13T22:46:31.113ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14832025-01-13T22:46:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14842025-01-13T22:46:31.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14852025-01-13T22:46:31.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14862025-01-13T22:46:31.120ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14872025-01-13T22:46:31.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.317869ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
14882025-01-13T22:46:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14892025-01-13T22:46:31.122ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14902025-01-13T22:46:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14912025-01-13T22:46:31.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922025-01-13T22:46:31.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14932025-01-13T22:46:31.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14942025-01-13T22:46:31.128ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14952025-01-13T22:46:31.129ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14962025-01-13T22:46:31.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14972025-01-13T22:46:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14982025-01-13T22:46:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14992025-01-13T22:46:31.130ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15002025-01-13T22:46:31.130ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15012025-01-13T22:46:31.130ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.401645ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15022025-01-13T22:46:31.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15032025-01-13T22:46:31.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042025-01-13T22:46:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15052025-01-13T22:46:31.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.664436ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
15062025-01-13T22:46:31.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15072025-01-13T22:46:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15082025-01-13T22:46:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15092025-01-13T22:46:31.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15102025-01-13T22:46:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15112025-01-13T22:46:31.145ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122025-01-13T22:46:31.145ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15132025-01-13T22:46:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15142025-01-13T22:46:31.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152025-01-13T22:46:31.146ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15162025-01-13T22:46:31.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172025-01-13T22:46:31.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15182025-01-13T22:46:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
15192025-01-13T22:46:31.148ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15202025-01-13T22:46:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15212025-01-13T22:46:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15222025-01-13T22:46:31.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15232025-01-13T22:46:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15242025-01-13T22:46:31.149ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252025-01-13T22:46:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
15262025-01-13T22:46:31.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15272025-01-13T22:46:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15282025-01-13T22:46:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15292025-01-13T22:46:31.152ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15302025-01-13T22:46:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15312025-01-13T22:46:31.155ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15322025-01-13T22:46:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15332025-01-13T22:46:31.160ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15342025-01-13T22:46:31.160ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15352025-01-13T22:46:31.160ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15362025-01-13T22:46:31.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15372025-01-13T22:46:31.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15382025-01-13T22:46:31.161ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15392025-01-13T22:46:31.162ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15402025-01-13T22:46:31.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15412025-01-13T22:46:31.162ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2850, tv_nsec: 785275432 } })
15422025-01-13T22:46:31.163ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
15432025-01-13T22:46:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15442025-01-13T22:46:31.163ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15452025-01-13T22:46:31.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15462025-01-13T22:46:31.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472025-01-13T22:46:31.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482025-01-13T22:46:31.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.761079ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15492025-01-13T22:46:31.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15502025-01-13T22:46:31.168ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15512025-01-13T22:46:31.168ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15522025-01-13T22:46:31.168ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15532025-01-13T22:46:31.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15542025-01-13T22:46:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15552025-01-13T22:46:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15562025-01-13T22:46:31.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15572025-01-13T22:46:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15582025-01-13T22:46:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
15592025-01-13T22:46:31.170ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15602025-01-13T22:46:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15612025-01-13T22:46:31.171ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
15622025-01-13T22:46:31.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.361973ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
15632025-01-13T22:46:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15642025-01-13T22:46:31.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15652025-01-13T22:46:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15662025-01-13T22:46:31.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15672025-01-13T22:46:31.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682025-01-13T22:46:31.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15692025-01-13T22:46:31.174ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 102.016598ms iteration = 3 status = {"nsuccess":5}
15702025-01-13T22:46:31.177ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
15712025-01-13T22:46:31.177ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 104.512387ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
15722025-01-13T22:46:31.177ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15732025-01-13T22:46:31.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.115675ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15742025-01-13T22:46:31.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15752025-01-13T22:46:31.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15762025-01-13T22:46:31.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15772025-01-13T22:46:31.181ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15782025-01-13T22:46:31.181ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15792025-01-13T22:46:31.181ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 108.854683ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15802025-01-13T22:46:31.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15812025-01-13T22:46:31.181ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15822025-01-13T22:46:31.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15832025-01-13T22:46:31.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15842025-01-13T22:46:31.183ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15852025-01-13T22:46:31.183ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15862025-01-13T22:46:31.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15872025-01-13T22:46:31.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15882025-01-13T22:46:31.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892025-01-13T22:46:31.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15902025-01-13T22:46:31.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15912025-01-13T22:46:31.185ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15922025-01-13T22:46:31.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
15932025-01-13T22:46:31.188ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15942025-01-13T22:46:31.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15952025-01-13T22:46:31.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15962025-01-13T22:46:31.189ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15972025-01-13T22:46:31.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15982025-01-13T22:46:31.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15992025-01-13T22:46:31.191ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16002025-01-13T22:46:31.191ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.221489ms iteration = 7 status = 0
16012025-01-13T22:46:31.192ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16022025-01-13T22:46:31.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16032025-01-13T22:46:31.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16042025-01-13T22:46:31.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16052025-01-13T22:46:31.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16062025-01-13T22:46:31.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16072025-01-13T22:46:31.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.679787ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16082025-01-13T22:46:31.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16092025-01-13T22:46:31.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16102025-01-13T22:46:31.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16112025-01-13T22:46:31.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16122025-01-13T22:46:31.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132025-01-13T22:46:31.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.869329ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16142025-01-13T22:46:31.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16152025-01-13T22:46:31.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16162025-01-13T22:46:31.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16172025-01-13T22:46:31.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16182025-01-13T22:46:31.216ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16192025-01-13T22:46:31.216ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16202025-01-13T22:46:31.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16212025-01-13T22:46:31.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16222025-01-13T22:46:31.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16232025-01-13T22:46:31.216ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec2c7c10-75cb-4211-a0c4-102b5cdfeae8", "content-length": "26", "date": "Mon, 13 Jan 2025 22:46:30 GMT"} })
16242025-01-13T22:46:31.217ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16252025-01-13T22:46:31.219ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16262025-01-13T22:46:31.221ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16272025-01-13T22:46:31.221ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16282025-01-13T22:46:31.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16292025-01-13T22:46:31.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16302025-01-13T22:46:31.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312025-01-13T22:46:31.225ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16322025-01-13T22:46:31.225ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
16332025-01-13T22:46:31.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16342025-01-13T22:46:31.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16352025-01-13T22:46:31.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16362025-01-13T22:46:31.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16372025-01-13T22:46:31.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16382025-01-13T22:46:31.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16392025-01-13T22:46:31.228ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16402025-01-13T22:46:31.228ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16412025-01-13T22:46:31.229ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcba81e8-4363-4928-b50f-ce5d714bc93f", "content-length": "26", "date": "Mon, 13 Jan 2025 22:46:30 GMT"} })
16422025-01-13T22:46:31.229ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16432025-01-13T22:46:31.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16442025-01-13T22:46:31.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16452025-01-13T22:46:31.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16462025-01-13T22:46:31.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16472025-01-13T22:46:31.233ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16482025-01-13T22:46:31.233ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16492025-01-13T22:46:31.233ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.524006ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16502025-01-13T22:46:31.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 175.524659ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16512025-01-13T22:46:31.249ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16522025-01-13T22:46:31.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 176.408497ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16532025-01-13T22:46:31.268ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
16542025-01-13T22:46:31.268ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 196.317383ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16552025-01-13T22:46:31.287ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.445163ms iteration = 9 status = {"physical_disks_added":0}
16562025-01-13T22:46:31.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
16572025-01-13T22:46:31.341ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16582025-01-13T22:46:31.341ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12719372-68a7-4050-b8d3-b28a876e77da", "content-length": "26", "date": "Mon, 13 Jan 2025 22:46:30 GMT"} })
16592025-01-13T22:46:31.341ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16602025-01-13T22:46:31.343ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
16612025-01-13T22:46:31.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16622025-01-13T22:46:31.398ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16632025-01-13T22:46:31.398ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0b99ab32-3ce2-412e-9809-2c748a1d7a38", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16642025-01-13T22:46:31.398ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16652025-01-13T22:46:31.399ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "56110c21-29e3-4acc-a09c-4b337195efed", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16662025-01-13T22:46:31.399ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16672025-01-13T22:46:31.401ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16682025-01-13T22:46:31.401ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 329.303845ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16692025-01-13T22:46:31.408ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16702025-01-13T22:46:31.408ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf2f2ce1-717e-4961-8322-77d436137126", "content-length": "1", "date": "Mon, 13 Jan 2025 22:46:30 GMT"} })
16712025-01-13T22:46:31.409ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16722025-01-13T22:46:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16732025-01-13T22:46:31.439ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.510155ms iteration = 7 status = {}
16742025-01-13T22:46:31.520ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16752025-01-13T22:46:31.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fe15ea72-9a26-4fc0-811a-f096ebeb4c85", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16762025-01-13T22:46:31.520ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16772025-01-13T22:46:31.522ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "55acc920-43b4-4dcb-9d22-4f072d389421", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16782025-01-13T22:46:31.522ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16792025-01-13T22:46:31.524ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "956ec3ab-1702-4c59-9071-ce9f2e6f950d", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16802025-01-13T22:46:31.524ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16812025-01-13T22:46:31.525ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16822025-01-13T22:46:31.525ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 453.411197ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16832025-01-13T22:46:31.529ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16842025-01-13T22:46:31.529ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16852025-01-13T22:46:31.529ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16862025-01-13T22:46:31.529ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c89137f7-b245-4989-9824-bad419217271", "content-length": "372", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
16872025-01-13T22:46:31.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16882025-01-13T22:46:31.530ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5ceb6a3-3720-46d8-892c-ee3ed403ec26", "content-length": "691", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
16892025-01-13T22:46:31.530ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16902025-01-13T22:46:31.530ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16912025-01-13T22:46:31.530ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16922025-01-13T22:46:31.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16932025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
16942025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16952025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
16962025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 460.1761ms iteration = 4 status = {"generation":2}
16972025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 459.284452ms iteration = 7 status = null
16982025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.485068ms iteration = 7 status = {}
16992025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17002025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17012025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
17022025-01-13T22:46:31.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 460.452148ms iteration = 4 status = {"generation":1}
17032025-01-13T22:46:31.571ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17042025-01-13T22:46:31.571ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17052025-01-13T22:46:31.571ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53174c8d-ac62-437d-84ec-6d5db3ccc7cb", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17062025-01-13T22:46:31.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17072025-01-13T22:46:31.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17082025-01-13T22:46:31.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17092025-01-13T22:46:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17102025-01-13T22:46:31.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17112025-01-13T22:46:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17122025-01-13T22:46:31.580ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17132025-01-13T22:46:31.580ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17142025-01-13T22:46:31.580ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cd65a32d-93ff-4be2-927c-0d7a5992b34e", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17152025-01-13T22:46:31.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17162025-01-13T22:46:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17172025-01-13T22:46:31.581ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 508.862121ms iteration = 7 status = {}
17182025-01-13T22:46:31.583ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
17192025-01-13T22:46:31.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17202025-01-13T22:46:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17212025-01-13T22:46:31.591ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17222025-01-13T22:46:31.591ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f9da253-621c-4a84-b033-9b60f0dd0c94", "content-length": "134", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17232025-01-13T22:46:31.591ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17242025-01-13T22:46:31.591ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
17252025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17262025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17272025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17282025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17292025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17302025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17312025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17322025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17332025-01-13T22:46:31.592ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
17342025-01-13T22:46:31.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17352025-01-13T22:46:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17362025-01-13T22:46:31.595ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17372025-01-13T22:46:31.595ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "63b10b5f-bf66-4201-8376-d842c6fc3c2a", "content-length": "2", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17382025-01-13T22:46:31.595ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17392025-01-13T22:46:31.595ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "27a47813-5b7d-4b52-8ae4-ff0511e0b9ec", "content-length": "51", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17402025-01-13T22:46:31.595ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
17412025-01-13T22:46:31.595ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17422025-01-13T22:46:31.686ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d85e7f37-ff57-478d-a7d9-f8bc265479ba", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17432025-01-13T22:46:31.686ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
17442025-01-13T22:46:31.686ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17452025-01-13T22:46:31.686ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a185808-a719-42d1-9215-6072f60d7fea", "content-length": "682", "date": "Mon, 13 Jan 2025 22:46:31 GMT"} })
17462025-01-13T22:46:31.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17472025-01-13T22:46:31.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17482025-01-13T22:46:31.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17492025-01-13T22:46:31.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17502025-01-13T22:46:31.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17512025-01-13T22:46:31.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17522025-01-13T22:46:31.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17532025-01-13T22:46:31.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17542025-01-13T22:46:31.701ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 629.113743ms iteration = 7 status = {}
17552025-01-13T22:46:31.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ac21f758-ed0a-4b52-a718-2511061ee515 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17562025-01-13T22:46:31.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ac21f758-ed0a-4b52-a718-2511061ee515 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17572025-01-13T22:46:31.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ac21f758-ed0a-4b52-a718-2511061ee515 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17582025-01-13T22:46:32.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fcc0b69-8d39-4fc3-b01c-b2085a6ef045 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17592025-01-13T22:46:32.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fcc0b69-8d39-4fc3-b01c-b2085a6ef045 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17602025-01-13T22:46:32.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fcc0b69-8d39-4fc3-b01c-b2085a6ef045 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17612025-01-13T22:46:33.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a574e81b-8d2f-457e-8f15-332e33b682ef roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17622025-01-13T22:46:33.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a574e81b-8d2f-457e-8f15-332e33b682ef resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17632025-01-13T22:46:33.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a574e81b-8d2f-457e-8f15-332e33b682ef response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17642025-01-13T22:46:33.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 876 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 6a7380f2-55bb-4313-b254-39cdef96f832 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
17652025-01-13T22:46:34.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d875905f-35fd-4cba-a087-27fb5f36ab5e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17662025-01-13T22:46:34.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d875905f-35fd-4cba-a087-27fb5f36ab5e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17672025-01-13T22:46:34.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d875905f-35fd-4cba-a087-27fb5f36ab5e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17682025-01-13T22:46:35.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4748c719-3077-443b-a87f-879f2bf0b322 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17692025-01-13T22:46:35.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4748c719-3077-443b-a87f-879f2bf0b322 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17702025-01-13T22:46:35.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4748c719-3077-443b-a87f-879f2bf0b322 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17712025-01-13T22:46:36.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 33dd7310-d927-452c-9ed2-244463931070 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17722025-01-13T22:46:36.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 33dd7310-d927-452c-9ed2-244463931070 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17732025-01-13T22:46:36.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 33dd7310-d927-452c-9ed2-244463931070 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17742025-01-13T22:46:37.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12ab8b90-ff02-41ff-b573-5c3c89758ba6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17752025-01-13T22:46:37.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12ab8b90-ff02-41ff-b573-5c3c89758ba6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17762025-01-13T22:46:37.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12ab8b90-ff02-41ff-b573-5c3c89758ba6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17772025-01-13T22:46:38.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d559ad7-abe9-47c1-954c-225286e9a9ba roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17782025-01-13T22:46:38.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d559ad7-abe9-47c1-954c-225286e9a9ba resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17792025-01-13T22:46:38.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d559ad7-abe9-47c1-954c-225286e9a9ba response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17802025-01-13T22:46:39.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 49735edf-1da1-4b4f-a425-39bc38a7a63d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17812025-01-13T22:46:39.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 49735edf-1da1-4b4f-a425-39bc38a7a63d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17822025-01-13T22:46:39.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 49735edf-1da1-4b4f-a425-39bc38a7a63d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17832025-01-13T22:46:40.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d39f1f19-cf56-4e11-a0d4-936793021d32 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17842025-01-13T22:46:40.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d39f1f19-cf56-4e11-a0d4-936793021d32 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17852025-01-13T22:46:40.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d39f1f19-cf56-4e11-a0d4-936793021d32 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
17862025-01-13T22:46:41.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
17872025-01-13T22:46:41.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
17882025-01-13T22:46:41.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17892025-01-13T22:46:41.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17902025-01-13T22:46:41.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17912025-01-13T22:46:41.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17922025-01-13T22:46:41.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932025-01-13T22:46:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17942025-01-13T22:46:41.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17952025-01-13T22:46:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17962025-01-13T22:46:41.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17972025-01-13T22:46:41.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982025-01-13T22:46:41.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992025-01-13T22:46:41.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
18002025-01-13T22:46:41.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18012025-01-13T22:46:41.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18022025-01-13T22:46:41.099ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
18032025-01-13T22:46:41.099ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.815662ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
18042025-01-13T22:46:41.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18052025-01-13T22:46:41.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18062025-01-13T22:46:41.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.280902ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18072025-01-13T22:46:41.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50b5b386-4998-49b5-bf53-c3f674c8cce7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18082025-01-13T22:46:41.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50b5b386-4998-49b5-bf53-c3f674c8cce7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18092025-01-13T22:46:41.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50b5b386-4998-49b5-bf53-c3f674c8cce7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18102025-01-13T22:46:42.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e64c047d-9c8b-48b7-8f29-07e3726e6be5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18112025-01-13T22:46:42.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e64c047d-9c8b-48b7-8f29-07e3726e6be5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18122025-01-13T22:46:42.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e64c047d-9c8b-48b7-8f29-07e3726e6be5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18132025-01-13T22:46:43.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ff00c377-59cd-41c0-b8a7-7f91cad81cec roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18142025-01-13T22:46:43.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ff00c377-59cd-41c0-b8a7-7f91cad81cec resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18152025-01-13T22:46:43.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ff00c377-59cd-41c0-b8a7-7f91cad81cec response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18162025-01-13T22:46:43.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = dc9f3fcc-1a26-4a0b-89bd-859b48ccc724 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
18172025-01-13T22:46:44.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7908f8dc-2b08-4e20-9938-674f6729e618 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18182025-01-13T22:46:44.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7908f8dc-2b08-4e20-9938-674f6729e618 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18192025-01-13T22:46:44.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7908f8dc-2b08-4e20-9938-674f6729e618 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18202025-01-13T22:46:45.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3699523-da45-4983-9485-1d43eed6d46a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18212025-01-13T22:46:45.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3699523-da45-4983-9485-1d43eed6d46a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18222025-01-13T22:46:45.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3699523-da45-4983-9485-1d43eed6d46a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18232025-01-13T22:46:46.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e1865635-67d0-4bbd-b8f7-123805438455 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18242025-01-13T22:46:46.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e1865635-67d0-4bbd-b8f7-123805438455 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18252025-01-13T22:46:46.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e1865635-67d0-4bbd-b8f7-123805438455 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18262025-01-13T22:46:47.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 34b9c999-1d58-4052-9092-ae90f7a71003 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18272025-01-13T22:46:47.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 34b9c999-1d58-4052-9092-ae90f7a71003 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18282025-01-13T22:46:47.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 34b9c999-1d58-4052-9092-ae90f7a71003 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18292025-01-13T22:46:48.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 380757e7-f718-43e1-9fba-077f02b3a308 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18302025-01-13T22:46:48.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 380757e7-f718-43e1-9fba-077f02b3a308 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18312025-01-13T22:46:48.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 380757e7-f718-43e1-9fba-077f02b3a308 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18322025-01-13T22:46:49.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 33a747fd-2189-451b-97dd-745fcfbfca48 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18332025-01-13T22:46:49.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 33a747fd-2189-451b-97dd-745fcfbfca48 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18342025-01-13T22:46:49.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 33a747fd-2189-451b-97dd-745fcfbfca48 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18352025-01-13T22:46:50.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2697c57c-fe5f-42ba-afd1-c44429b6869f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18362025-01-13T22:46:50.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2697c57c-fe5f-42ba-afd1-c44429b6869f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18372025-01-13T22:46:50.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2697c57c-fe5f-42ba-afd1-c44429b6869f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18382025-01-13T22:46:51.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
18392025-01-13T22:46:51.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
18402025-01-13T22:46:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18412025-01-13T22:46:51.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18422025-01-13T22:46:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18432025-01-13T22:46:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18442025-01-13T22:46:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18452025-01-13T22:46:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18462025-01-13T22:46:51.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18472025-01-13T22:46:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18482025-01-13T22:46:51.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18492025-01-13T22:46:51.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18502025-01-13T22:46:51.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18512025-01-13T22:46:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
18522025-01-13T22:46:51.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18532025-01-13T22:46:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18542025-01-13T22:46:51.098ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
18552025-01-13T22:46:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.982367ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
18562025-01-13T22:46:51.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18572025-01-13T22:46:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18582025-01-13T22:46:51.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.187393ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18592025-01-13T22:46:51.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 272f75e2-717d-4778-b4ff-eae2e56099f3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18602025-01-13T22:46:51.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 272f75e2-717d-4778-b4ff-eae2e56099f3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18612025-01-13T22:46:51.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 272f75e2-717d-4778-b4ff-eae2e56099f3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18622025-01-13T22:46:52.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d5b2689a-cc96-455e-b140-f22f72a25c0b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18632025-01-13T22:46:52.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d5b2689a-cc96-455e-b140-f22f72a25c0b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18642025-01-13T22:46:52.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d5b2689a-cc96-455e-b140-f22f72a25c0b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18652025-01-13T22:46:53.513ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 903 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = d170e4cf-0f87-4fea-84ad-4a4da68b0a38 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
18662025-01-13T22:46:53.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3fff01b3-cdf4-4c23-a9eb-e6ae2934b07d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18672025-01-13T22:46:53.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3fff01b3-cdf4-4c23-a9eb-e6ae2934b07d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18682025-01-13T22:46:53.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3fff01b3-cdf4-4c23-a9eb-e6ae2934b07d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18692025-01-13T22:46:54.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fcbd5573-b46c-4ca7-9fcd-b79210c7333b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18702025-01-13T22:46:54.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fcbd5573-b46c-4ca7-9fcd-b79210c7333b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18712025-01-13T22:46:54.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fcbd5573-b46c-4ca7-9fcd-b79210c7333b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18722025-01-13T22:46:55.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d7d2819-ccf4-462a-a6e5-a998142fec49 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18732025-01-13T22:46:55.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d7d2819-ccf4-462a-a6e5-a998142fec49 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18742025-01-13T22:46:55.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d7d2819-ccf4-462a-a6e5-a998142fec49 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18752025-01-13T22:46:56.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7988956a-a119-429d-bec8-b6ef99bc3f2d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18762025-01-13T22:46:56.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7988956a-a119-429d-bec8-b6ef99bc3f2d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18772025-01-13T22:46:56.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7988956a-a119-429d-bec8-b6ef99bc3f2d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18782025-01-13T22:46:57.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d03cd5fb-082b-4fca-b305-e22d71ba8131 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18792025-01-13T22:46:57.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d03cd5fb-082b-4fca-b305-e22d71ba8131 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18802025-01-13T22:46:57.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d03cd5fb-082b-4fca-b305-e22d71ba8131 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18812025-01-13T22:46:58.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 325082cc-03bd-4126-aae5-e3ef4f57897e roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
18822025-01-13T22:46:58.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 325082cc-03bd-4126-aae5-e3ef4f57897e resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
18832025-01-13T22:46:58.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 325082cc-03bd-4126-aae5-e3ef4f57897e response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
18842025-01-13T22:46:58.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 8be43c7c-a758-41e6-bbd7-2af072608def roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
18852025-01-13T22:46:58.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 8be43c7c-a758-41e6-bbd7-2af072608def resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
18862025-01-13T22:46:58.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 8be43c7c-a758-41e6-bbd7-2af072608def response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
18872025-01-13T22:46:58.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9cf7db1c-6aa0-479d-913c-24c7b54f558d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18882025-01-13T22:46:58.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9cf7db1c-6aa0-479d-913c-24c7b54f558d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18892025-01-13T22:46:58.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9cf7db1c-6aa0-479d-913c-24c7b54f558d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18902025-01-13T22:46:59.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b0a5716-665f-46de-a7cd-2d1331e4a409 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18912025-01-13T22:46:59.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b0a5716-665f-46de-a7cd-2d1331e4a409 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18922025-01-13T22:46:59.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b0a5716-665f-46de-a7cd-2d1331e4a409 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18932025-01-13T22:47:00.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 74e526d9-5fc8-4f07-81b3-ba91ac2f9bc2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18942025-01-13T22:47:00.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 74e526d9-5fc8-4f07-81b3-ba91ac2f9bc2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18952025-01-13T22:47:00.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 74e526d9-5fc8-4f07-81b3-ba91ac2f9bc2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
18962025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
18972025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18982025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
18992025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19002025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
19012025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
19022025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
19032025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19042025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19052025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
19062025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19072025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
19082025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19092025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
19102025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19112025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
19122025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19132025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19142025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
19152025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19162025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
19172025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19182025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
19192025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19202025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
19212025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19222025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
19232025-01-13T22:47:01.072ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19242025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
19252025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19262025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19272025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
19282025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19292025-01-13T22:47:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
19302025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19312025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
19322025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19332025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19342025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19352025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19362025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19372025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19382025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19392025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19402025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19412025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19422025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19432025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19442025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19452025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19462025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19472025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19482025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19492025-01-13T22:47:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19502025-01-13T22:47:01.075ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.949652ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19512025-01-13T22:47:01.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2880, tv_nsec: 699539346 } })
19522025-01-13T22:47:01.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19532025-01-13T22:47:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19542025-01-13T22:47:01.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19552025-01-13T22:47:01.077ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19562025-01-13T22:47:01.078ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2880, tv_nsec: 701723484 } })
19572025-01-13T22:47:01.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
19582025-01-13T22:47:01.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592025-01-13T22:47:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19602025-01-13T22:47:01.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19612025-01-13T22:47:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19622025-01-13T22:47:01.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19632025-01-13T22:47:01.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19642025-01-13T22:47:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19652025-01-13T22:47:01.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662025-01-13T22:47:01.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672025-01-13T22:47:01.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19682025-01-13T22:47:01.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19692025-01-13T22:47:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19702025-01-13T22:47:01.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19712025-01-13T22:47:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19722025-01-13T22:47:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19732025-01-13T22:47:01.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19742025-01-13T22:47:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19752025-01-13T22:47:01.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19762025-01-13T22:47:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19772025-01-13T22:47:01.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19782025-01-13T22:47:01.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792025-01-13T22:47:01.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19802025-01-13T22:47:01.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19812025-01-13T22:47:01.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19822025-01-13T22:47:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19832025-01-13T22:47:01.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19842025-01-13T22:47:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19852025-01-13T22:47:01.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19862025-01-13T22:47:01.096ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19872025-01-13T22:47:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19882025-01-13T22:47:01.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19892025-01-13T22:47:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19902025-01-13T22:47:01.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19912025-01-13T22:47:01.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19922025-01-13T22:47:01.099ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2880, tv_nsec: 722114796 } })
19932025-01-13T22:47:01.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19942025-01-13T22:47:01.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
19952025-01-13T22:47:01.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19962025-01-13T22:47:01.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
19972025-01-13T22:47:01.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19982025-01-13T22:47:01.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19992025-01-13T22:47:01.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20002025-01-13T22:47:01.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20012025-01-13T22:47:01.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20022025-01-13T22:47:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20032025-01-13T22:47:01.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20042025-01-13T22:47:01.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20052025-01-13T22:47:01.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20062025-01-13T22:47:01.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20072025-01-13T22:47:01.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
20082025-01-13T22:47:01.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.977502ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
20092025-01-13T22:47:01.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.933316ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
20102025-01-13T22:47:01.127ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20112025-01-13T22:47:01.127ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20122025-01-13T22:47:01.127ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20132025-01-13T22:47:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20142025-01-13T22:47:01.134ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20152025-01-13T22:47:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20162025-01-13T22:47:01.135ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172025-01-13T22:47:01.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.022873ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
20182025-01-13T22:47:01.137ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20192025-01-13T22:47:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20202025-01-13T22:47:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20212025-01-13T22:47:01.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20222025-01-13T22:47:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20232025-01-13T22:47:01.139ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20242025-01-13T22:47:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20252025-01-13T22:47:01.139ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262025-01-13T22:47:01.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20272025-01-13T22:47:01.141ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20282025-01-13T22:47:01.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.148904ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20292025-01-13T22:47:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20302025-01-13T22:47:01.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.53673ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20312025-01-13T22:47:01.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.582852ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20322025-01-13T22:47:01.172ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20332025-01-13T22:47:01.172ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20342025-01-13T22:47:01.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20352025-01-13T22:47:01.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20362025-01-13T22:47:01.178ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20372025-01-13T22:47:01.178ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20382025-01-13T22:47:01.178ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d795e96-2b7b-41c7-83ba-58a42e5acdda", "content-length": "26", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
20392025-01-13T22:47:01.178ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20402025-01-13T22:47:01.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20412025-01-13T22:47:01.180ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20422025-01-13T22:47:01.180ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a863437b-5d21-4672-89d8-ebdaf2e821ab", "content-length": "26", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
20432025-01-13T22:47:01.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20442025-01-13T22:47:01.180ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20452025-01-13T22:47:01.181ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.833462ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20462025-01-13T22:47:01.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20472025-01-13T22:47:01.183ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
20482025-01-13T22:47:01.183ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 110.64567ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20492025-01-13T22:47:01.185ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20502025-01-13T22:47:01.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.731495ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20512025-01-13T22:47:01.197ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
20522025-01-13T22:47:01.197ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20532025-01-13T22:47:01.198ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "052a10b8-f7c8-4723-b364-6dfa1363e2f8", "content-length": "26", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
20542025-01-13T22:47:01.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20552025-01-13T22:47:01.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
20562025-01-13T22:47:01.212ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20572025-01-13T22:47:01.212ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20582025-01-13T22:47:01.212ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.374392ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20592025-01-13T22:47:01.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20602025-01-13T22:47:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20612025-01-13T22:47:01.252ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.400541ms iteration = 10 status = {"physical_disks_added":0}
20622025-01-13T22:47:01.278ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.221405ms iteration = 8 status = {}
20632025-01-13T22:47:01.305ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20642025-01-13T22:47:01.305ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20652025-01-13T22:47:01.305ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "15c955c7-8435-42ea-aa75-115976b4a987", "content-length": "372", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
20662025-01-13T22:47:01.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20672025-01-13T22:47:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20682025-01-13T22:47:01.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692025-01-13T22:47:01.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20702025-01-13T22:47:01.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20712025-01-13T22:47:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20722025-01-13T22:47:01.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20732025-01-13T22:47:01.311ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20742025-01-13T22:47:01.312ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bc08133-2e80-4113-af10-cc0621084b75", "content-length": "1", "date": "Mon, 13 Jan 2025 22:47:00 GMT"} })
20752025-01-13T22:47:01.313ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20762025-01-13T22:47:01.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20772025-01-13T22:47:01.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20782025-01-13T22:47:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20792025-01-13T22:47:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20802025-01-13T22:47:01.316ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 243.964411ms iteration = 8 status = null
20812025-01-13T22:47:01.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20822025-01-13T22:47:01.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20832025-01-13T22:47:01.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20842025-01-13T22:47:01.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20852025-01-13T22:47:01.368ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20862025-01-13T22:47:01.368ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20872025-01-13T22:47:01.368ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "711901b8-fde3-43b3-964e-316a2b91acea", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
20882025-01-13T22:47:01.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20892025-01-13T22:47:01.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20902025-01-13T22:47:01.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20912025-01-13T22:47:01.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20922025-01-13T22:47:01.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20932025-01-13T22:47:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20942025-01-13T22:47:01.380ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20952025-01-13T22:47:01.380ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20962025-01-13T22:47:01.381ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9d802385-2d21-45c8-8a24-bc4d4c6bcb76", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
20972025-01-13T22:47:01.383ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 310.197094ms iteration = 8 status = {}
20982025-01-13T22:47:01.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20992025-01-13T22:47:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
21002025-01-13T22:47:01.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21012025-01-13T22:47:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21022025-01-13T22:47:01.399ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 326.753045ms iteration = 8 status = 0
21032025-01-13T22:47:01.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21042025-01-13T22:47:01.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21052025-01-13T22:47:01.419ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
21062025-01-13T22:47:01.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21072025-01-13T22:47:01.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21082025-01-13T22:47:01.447ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21092025-01-13T22:47:01.448ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0cfc905-9d46-4f3a-b3ac-e2e4249ef45c", "content-length": "691", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
21102025-01-13T22:47:01.448ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21112025-01-13T22:47:01.448ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21122025-01-13T22:47:01.448ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21132025-01-13T22:47:01.450ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.261803ms iteration = 8 status = {}
21142025-01-13T22:47:01.536ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21152025-01-13T22:47:01.536ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "53af8b8f-38c9-4e1c-b238-4475ba0adeef", "content-length": "134", "date": "Mon, 13 Jan 2025 22:47:00 GMT"} })
21162025-01-13T22:47:01.536ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21172025-01-13T22:47:01.536ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
21182025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21192025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21202025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21212025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21222025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21232025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21242025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21252025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21262025-01-13T22:47:01.537ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
21272025-01-13T22:47:01.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21282025-01-13T22:47:01.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21292025-01-13T22:47:01.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21302025-01-13T22:47:01.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "92f2f4c5-2503-494d-aece-a7c6933d4e07", "content-length": "2", "date": "Mon, 13 Jan 2025 22:47:00 GMT"} })
21312025-01-13T22:47:01.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21322025-01-13T22:47:01.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "434fdd08-c1d8-4c20-8f8a-408de408f998", "content-length": "51", "date": "Mon, 13 Jan 2025 22:47:00 GMT"} })
21332025-01-13T22:47:01.539ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
21342025-01-13T22:47:01.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21352025-01-13T22:47:01.621ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21362025-01-13T22:47:01.621ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
21372025-01-13T22:47:01.651ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
21382025-01-13T22:47:01.652ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60834
21392025-01-13T22:47:01.652ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "394bca5d-f4ea-466d-8342-eaccdffd2ffd", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
21402025-01-13T22:47:01.652ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
21412025-01-13T22:47:01.652ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21422025-01-13T22:47:01.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60834 req_id = b917d9ce-b14a-4cb0-be38-f2d00437c557 roles = RoleSet { roles: {} } uri = /metrics/producers
21432025-01-13T22:47:01.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60834 req_id = b917d9ce-b14a-4cb0-be38-f2d00437c557 resource = Database result = Ok(()) uri = /metrics/producers
21442025-01-13T22:47:01.652ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "36269c93-a0ea-46d4-9d11-594a781baa74", "content-length": "682", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
21452025-01-13T22:47:01.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21462025-01-13T22:47:01.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21472025-01-13T22:47:01.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21482025-01-13T22:47:01.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21492025-01-13T22:47:01.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21502025-01-13T22:47:01.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21512025-01-13T22:47:01.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21522025-01-13T22:47:01.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21532025-01-13T22:47:01.668ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 596.008152ms iteration = 8 status = {}
21542025-01-13T22:47:01.686ZINFOnexus: assigned collector to new producer collector_id = 6a8a13ba-b82f-41ac-997c-fb535838d6a4 file = nexus/src/app/oximeter.rs:76 producer_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
21552025-01-13T22:47:01.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34687 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60834 req_id = b917d9ce-b14a-4cb0-be38-f2d00437c557 response_code = 201 uri = /metrics/producers
21562025-01-13T22:47:01.686ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b917d9ce-b14a-4cb0-be38-f2d00437c557", "content-length": "41", "date": "Mon, 13 Jan 2025 22:47:01 GMT"} })
21572025-01-13T22:47:01.687ZDEBGnexus (producer-registration-task): registered with nexus successfully
21582025-01-13T22:47:01.687ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21592025-01-13T22:47:01.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c5af6a62-859d-4dda-8c30-6a3be423a406 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21602025-01-13T22:47:01.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c5af6a62-859d-4dda-8c30-6a3be423a406 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21612025-01-13T22:47:01.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c5af6a62-859d-4dda-8c30-6a3be423a406 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21622025-01-13T22:47:01.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9fd4cd14-dd36-47ec-b492-8b399202e915 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21632025-01-13T22:47:01.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9fd4cd14-dd36-47ec-b492-8b399202e915 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21642025-01-13T22:47:01.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9fd4cd14-dd36-47ec-b492-8b399202e915 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21652025-01-13T22:47:02.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d318b1dd-cae0-4c44-8d7d-1954d981bb9f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21662025-01-13T22:47:02.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d318b1dd-cae0-4c44-8d7d-1954d981bb9f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21672025-01-13T22:47:02.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d318b1dd-cae0-4c44-8d7d-1954d981bb9f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21682025-01-13T22:47:03.512ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 859 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 512609b4-9b82-4773-b7cf-d8f86c658fc9 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
21692025-01-13T22:47:03.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 258ef0ae-5bfc-495c-9042-c00acafc5156 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21702025-01-13T22:47:03.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 258ef0ae-5bfc-495c-9042-c00acafc5156 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21712025-01-13T22:47:03.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 258ef0ae-5bfc-495c-9042-c00acafc5156 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21722025-01-13T22:47:04.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 62c00e39-7912-4d65-af79-43d838cfdadf roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21732025-01-13T22:47:04.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 62c00e39-7912-4d65-af79-43d838cfdadf resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21742025-01-13T22:47:04.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 62c00e39-7912-4d65-af79-43d838cfdadf response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21752025-01-13T22:47:05.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 752b8b8c-2f46-4e14-85dd-caa3950402f3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21762025-01-13T22:47:05.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 752b8b8c-2f46-4e14-85dd-caa3950402f3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21772025-01-13T22:47:05.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 752b8b8c-2f46-4e14-85dd-caa3950402f3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21782025-01-13T22:47:06.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05476655-cf6e-46a1-adae-3cefa0cfa8ee roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21792025-01-13T22:47:06.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05476655-cf6e-46a1-adae-3cefa0cfa8ee resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21802025-01-13T22:47:06.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05476655-cf6e-46a1-adae-3cefa0cfa8ee response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21812025-01-13T22:47:07.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 009459d2-5af3-4e92-aee3-fb53580b2b3b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21822025-01-13T22:47:07.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 009459d2-5af3-4e92-aee3-fb53580b2b3b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21832025-01-13T22:47:07.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 009459d2-5af3-4e92-aee3-fb53580b2b3b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21842025-01-13T22:47:08.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc5ea2da-4d52-485f-a8b4-4f3daf8da2c0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21852025-01-13T22:47:08.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc5ea2da-4d52-485f-a8b4-4f3daf8da2c0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21862025-01-13T22:47:08.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc5ea2da-4d52-485f-a8b4-4f3daf8da2c0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21872025-01-13T22:47:09.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 548d2804-d876-4f1e-9d60-a35f86505182 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21882025-01-13T22:47:09.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 548d2804-d876-4f1e-9d60-a35f86505182 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21892025-01-13T22:47:09.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 548d2804-d876-4f1e-9d60-a35f86505182 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21902025-01-13T22:47:10.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9de832e2-659d-419d-afb1-5c26c834ea1f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21912025-01-13T22:47:10.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9de832e2-659d-419d-afb1-5c26c834ea1f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21922025-01-13T22:47:10.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9de832e2-659d-419d-afb1-5c26c834ea1f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
21932025-01-13T22:47:11.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
21942025-01-13T22:47:11.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
21952025-01-13T22:47:11.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21962025-01-13T22:47:11.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21972025-01-13T22:47:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21982025-01-13T22:47:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21992025-01-13T22:47:11.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22002025-01-13T22:47:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22012025-01-13T22:47:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22022025-01-13T22:47:11.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.664255ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22032025-01-13T22:47:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22042025-01-13T22:47:11.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22052025-01-13T22:47:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22062025-01-13T22:47:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22072025-01-13T22:47:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22082025-01-13T22:47:11.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22092025-01-13T22:47:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
22102025-01-13T22:47:11.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22112025-01-13T22:47:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22122025-01-13T22:47:11.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
22132025-01-13T22:47:11.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.999497ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
22142025-01-13T22:47:11.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3dfe1e69-3f73-45ba-b0cb-5f8ca56801d6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22152025-01-13T22:47:11.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3dfe1e69-3f73-45ba-b0cb-5f8ca56801d6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22162025-01-13T22:47:11.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3dfe1e69-3f73-45ba-b0cb-5f8ca56801d6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22172025-01-13T22:47:12.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d0ac8656-e954-461e-a334-27f402c2abc1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22182025-01-13T22:47:12.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d0ac8656-e954-461e-a334-27f402c2abc1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22192025-01-13T22:47:12.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d0ac8656-e954-461e-a334-27f402c2abc1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22202025-01-13T22:47:13.512ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 5689697b-02d5-4936-8c90-f424edf2652e response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
22212025-01-13T22:47:13.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 73a4af4c-ea65-4c28-9c96-c05a0aacae43 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22222025-01-13T22:47:13.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 73a4af4c-ea65-4c28-9c96-c05a0aacae43 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22232025-01-13T22:47:13.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 73a4af4c-ea65-4c28-9c96-c05a0aacae43 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22242025-01-13T22:47:15.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 857e9faa-e297-48b0-a293-71835b8f33ae roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22252025-01-13T22:47:15.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 857e9faa-e297-48b0-a293-71835b8f33ae resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22262025-01-13T22:47:15.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 857e9faa-e297-48b0-a293-71835b8f33ae response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22272025-01-13T22:47:16.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e166b70f-b898-49e4-a5f4-7c51a243b0aa roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22282025-01-13T22:47:16.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e166b70f-b898-49e4-a5f4-7c51a243b0aa resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22292025-01-13T22:47:16.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e166b70f-b898-49e4-a5f4-7c51a243b0aa response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22302025-01-13T22:47:17.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9eff0f3e-5493-407a-8d7c-1241363ca156 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22312025-01-13T22:47:17.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9eff0f3e-5493-407a-8d7c-1241363ca156 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22322025-01-13T22:47:17.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9eff0f3e-5493-407a-8d7c-1241363ca156 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22332025-01-13T22:47:18.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21e53840-da4a-4b9a-a199-eb53e1f2195f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22342025-01-13T22:47:18.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21e53840-da4a-4b9a-a199-eb53e1f2195f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22352025-01-13T22:47:18.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21e53840-da4a-4b9a-a199-eb53e1f2195f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22362025-01-13T22:47:19.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 399e2b45-04e8-4fbe-b1d3-b84093913602 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22372025-01-13T22:47:19.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 399e2b45-04e8-4fbe-b1d3-b84093913602 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22382025-01-13T22:47:19.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 399e2b45-04e8-4fbe-b1d3-b84093913602 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22392025-01-13T22:47:20.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53df3160-84c7-4634-aeaa-78c59443e49d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22402025-01-13T22:47:20.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53df3160-84c7-4634-aeaa-78c59443e49d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22412025-01-13T22:47:20.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53df3160-84c7-4634-aeaa-78c59443e49d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22422025-01-13T22:47:21.073ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
22432025-01-13T22:47:21.073ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
22442025-01-13T22:47:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22452025-01-13T22:47:21.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22462025-01-13T22:47:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22472025-01-13T22:47:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22482025-01-13T22:47:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492025-01-13T22:47:21.075ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22502025-01-13T22:47:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22512025-01-13T22:47:21.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.230223ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22522025-01-13T22:47:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22532025-01-13T22:47:21.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22542025-01-13T22:47:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22552025-01-13T22:47:21.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22562025-01-13T22:47:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22572025-01-13T22:47:21.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22582025-01-13T22:47:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
22592025-01-13T22:47:21.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22602025-01-13T22:47:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22612025-01-13T22:47:21.092ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
22622025-01-13T22:47:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.174453ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
22632025-01-13T22:47:21.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a28b61ad-c8e1-417a-93da-354299a2f92b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22642025-01-13T22:47:21.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a28b61ad-c8e1-417a-93da-354299a2f92b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22652025-01-13T22:47:21.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a28b61ad-c8e1-417a-93da-354299a2f92b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22662025-01-13T22:47:22.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f19cc452-211f-47ba-91d8-9a98100c1c0a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22672025-01-13T22:47:22.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f19cc452-211f-47ba-91d8-9a98100c1c0a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22682025-01-13T22:47:22.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f19cc452-211f-47ba-91d8-9a98100c1c0a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22692025-01-13T22:47:23.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d2cf8882-7647-4ed7-a3d8-ed17c86b63d9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22702025-01-13T22:47:23.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d2cf8882-7647-4ed7-a3d8-ed17c86b63d9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22712025-01-13T22:47:23.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d2cf8882-7647-4ed7-a3d8-ed17c86b63d9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22722025-01-13T22:47:23.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = fc5dcf68-3268-46d6-8c4d-f9fab1462d8b response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
22732025-01-13T22:47:24.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cae4932b-e453-45e1-b6ae-b6a623610ff9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22742025-01-13T22:47:24.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cae4932b-e453-45e1-b6ae-b6a623610ff9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22752025-01-13T22:47:24.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cae4932b-e453-45e1-b6ae-b6a623610ff9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22762025-01-13T22:47:25.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9cfd1c41-2407-4120-a675-bc5d4fd4fcae roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22772025-01-13T22:47:25.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9cfd1c41-2407-4120-a675-bc5d4fd4fcae resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22782025-01-13T22:47:25.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9cfd1c41-2407-4120-a675-bc5d4fd4fcae response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22792025-01-13T22:47:26.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bffad536-3159-4d7a-afde-7bfda729146d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22802025-01-13T22:47:26.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bffad536-3159-4d7a-afde-7bfda729146d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22812025-01-13T22:47:26.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bffad536-3159-4d7a-afde-7bfda729146d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22822025-01-13T22:47:27.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2d361c46-0667-4a32-afd2-01497aedaf4e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22832025-01-13T22:47:27.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2d361c46-0667-4a32-afd2-01497aedaf4e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22842025-01-13T22:47:27.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2d361c46-0667-4a32-afd2-01497aedaf4e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22852025-01-13T22:47:28.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb1c78f4-edd5-4a45-a83a-4dc75e1e5ed5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22862025-01-13T22:47:28.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb1c78f4-edd5-4a45-a83a-4dc75e1e5ed5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22872025-01-13T22:47:28.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb1c78f4-edd5-4a45-a83a-4dc75e1e5ed5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22882025-01-13T22:47:28.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 7909c485-5f81-4bd9-9ff3-00a6d1252f2a roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
22892025-01-13T22:47:28.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 7909c485-5f81-4bd9-9ff3-00a6d1252f2a resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
22902025-01-13T22:47:28.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 7909c485-5f81-4bd9-9ff3-00a6d1252f2a response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
22912025-01-13T22:47:28.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = e30a1077-3961-41ef-81fb-eb85baad9d27 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
22922025-01-13T22:47:28.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = e30a1077-3961-41ef-81fb-eb85baad9d27 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
22932025-01-13T22:47:28.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = e30a1077-3961-41ef-81fb-eb85baad9d27 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
22942025-01-13T22:47:29.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7b0d2cca-4470-4fc0-964c-7b907f68032c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22952025-01-13T22:47:29.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7b0d2cca-4470-4fc0-964c-7b907f68032c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22962025-01-13T22:47:29.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7b0d2cca-4470-4fc0-964c-7b907f68032c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22972025-01-13T22:47:30.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97731c46-5325-4e04-a3c0-978e63a60bc6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22982025-01-13T22:47:30.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97731c46-5325-4e04-a3c0-978e63a60bc6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
22992025-01-13T22:47:30.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97731c46-5325-4e04-a3c0-978e63a60bc6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
23002025-01-13T22:47:31.071ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
23012025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
23022025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23032025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
23042025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23052025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23062025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
23072025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23082025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
23092025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23102025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
23112025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
23122025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
23132025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23142025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
23152025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
23162025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23172025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23182025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
23192025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23202025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
23212025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23222025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
23232025-01-13T22:47:31.072ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23242025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23252025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
23262025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
23272025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23282025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23292025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
23302025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
23312025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23322025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
23332025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23342025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23352025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
23362025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23372025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23382025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
23392025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23402025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
23412025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
23422025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23432025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
23442025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23452025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
23462025-01-13T22:47:31.072ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:37:31.072290697 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23472025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
23482025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23492025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23502025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
23512025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23522025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
23532025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23542025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
23552025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23562025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
23572025-01-13T22:47:31.072ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23582025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23592025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
23602025-01-13T22:47:31.072ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
23612025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
23622025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.71\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
23632025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23642025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23652025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23662025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23672025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23682025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23692025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23702025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23712025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23722025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23732025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23742025-01-13T22:47:31.072ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2910, tv_nsec: 696120418 } })
23752025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23762025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23772025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23782025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23792025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23802025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23812025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23822025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23832025-01-13T22:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23842025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23852025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23862025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23872025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23882025-01-13T22:47:31.073ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2910, tv_nsec: 696231482 } })
23892025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23902025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23912025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23922025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.236499ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23932025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23942025-01-13T22:47:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.396434ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23952025-01-13T22:47:31.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23962025-01-13T22:47:31.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23972025-01-13T22:47:31.075ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23982025-01-13T22:47:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23992025-01-13T22:47:31.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24002025-01-13T22:47:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24012025-01-13T22:47:31.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24022025-01-13T22:47:31.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24032025-01-13T22:47:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24042025-01-13T22:47:31.076ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.683407ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24052025-01-13T22:47:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24062025-01-13T22:47:31.077ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24072025-01-13T22:47:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24082025-01-13T22:47:31.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24092025-01-13T22:47:31.082ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24102025-01-13T22:47:31.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112025-01-13T22:47:31.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122025-01-13T22:47:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24132025-01-13T22:47:31.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24142025-01-13T22:47:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24152025-01-13T22:47:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24162025-01-13T22:47:31.084ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24172025-01-13T22:47:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24182025-01-13T22:47:31.086ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2910, tv_nsec: 709982624 } })
24192025-01-13T22:47:31.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24202025-01-13T22:47:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24212025-01-13T22:47:31.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24222025-01-13T22:47:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24232025-01-13T22:47:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24242025-01-13T22:47:31.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24252025-01-13T22:47:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24262025-01-13T22:47:31.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272025-01-13T22:47:31.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2910, tv_nsec: 714022351 } })
24282025-01-13T22:47:31.090ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:37:31.072290697 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24292025-01-13T22:47:31.090ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.466591ms iteration = 5 status = {"expiration":"2025-01-13T22:37:31.072290697Z","pruned":[]}
24302025-01-13T22:47:31.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24312025-01-13T22:47:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24322025-01-13T22:47:31.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24332025-01-13T22:47:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24342025-01-13T22:47:31.092ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24352025-01-13T22:47:31.092ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24362025-01-13T22:47:31.092ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.210486ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24372025-01-13T22:47:31.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24382025-01-13T22:47:31.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24392025-01-13T22:47:31.097ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.684966ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
24402025-01-13T22:47:31.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24412025-01-13T22:47:31.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24422025-01-13T22:47:31.099ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24432025-01-13T22:47:31.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442025-01-13T22:47:31.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452025-01-13T22:47:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24462025-01-13T22:47:31.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2910, tv_nsec: 723902582 } })
24472025-01-13T22:47:31.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
24482025-01-13T22:47:31.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24492025-01-13T22:47:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24502025-01-13T22:47:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24512025-01-13T22:47:31.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24522025-01-13T22:47:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24532025-01-13T22:47:31.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24542025-01-13T22:47:31.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24552025-01-13T22:47:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24562025-01-13T22:47:31.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24572025-01-13T22:47:31.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24582025-01-13T22:47:31.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24592025-01-13T22:47:31.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24602025-01-13T22:47:31.105ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24612025-01-13T22:47:31.105ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24622025-01-13T22:47:31.105ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24632025-01-13T22:47:31.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24642025-01-13T22:47:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24652025-01-13T22:47:31.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662025-01-13T22:47:31.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24672025-01-13T22:47:31.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24682025-01-13T22:47:31.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24692025-01-13T22:47:31.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24702025-01-13T22:47:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24712025-01-13T22:47:31.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24722025-01-13T22:47:31.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24732025-01-13T22:47:31.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24742025-01-13T22:47:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24752025-01-13T22:47:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24762025-01-13T22:47:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
24772025-01-13T22:47:31.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24782025-01-13T22:47:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24792025-01-13T22:47:31.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24802025-01-13T22:47:31.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812025-01-13T22:47:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24822025-01-13T22:47:31.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24832025-01-13T22:47:31.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24842025-01-13T22:47:31.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24852025-01-13T22:47:31.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24862025-01-13T22:47:31.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24872025-01-13T22:47:31.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24882025-01-13T22:47:31.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24892025-01-13T22:47:31.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24902025-01-13T22:47:31.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24912025-01-13T22:47:31.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24922025-01-13T22:47:31.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24932025-01-13T22:47:31.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.369208ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
24942025-01-13T22:47:31.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24952025-01-13T22:47:31.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24962025-01-13T22:47:31.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24972025-01-13T22:47:31.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24982025-01-13T22:47:31.120ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24992025-01-13T22:47:31.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25002025-01-13T22:47:31.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
25012025-01-13T22:47:31.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.400713ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
25022025-01-13T22:47:31.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25032025-01-13T22:47:31.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25042025-01-13T22:47:31.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25052025-01-13T22:47:31.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25062025-01-13T22:47:31.129ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25072025-01-13T22:47:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25082025-01-13T22:47:31.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.131795ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
25092025-01-13T22:47:31.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25102025-01-13T22:47:31.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25112025-01-13T22:47:31.141ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25122025-01-13T22:47:31.141ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25132025-01-13T22:47:31.141ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25142025-01-13T22:47:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25152025-01-13T22:47:31.141ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25162025-01-13T22:47:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25172025-01-13T22:47:31.145ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25182025-01-13T22:47:31.145ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25192025-01-13T22:47:31.145ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25202025-01-13T22:47:31.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25212025-01-13T22:47:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25222025-01-13T22:47:31.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25232025-01-13T22:47:31.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25242025-01-13T22:47:31.146ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25252025-01-13T22:47:31.146ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25262025-01-13T22:47:31.146ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.764891ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25272025-01-13T22:47:31.152ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25282025-01-13T22:47:31.152ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.487031ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25292025-01-13T22:47:31.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25302025-01-13T22:47:31.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25312025-01-13T22:47:31.270ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25322025-01-13T22:47:31.270ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25332025-01-13T22:47:31.270ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8c7c67a-a59d-418f-972b-2904ea3473dc", "content-length": "26", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
25342025-01-13T22:47:31.270ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25352025-01-13T22:47:31.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25362025-01-13T22:47:31.281ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25372025-01-13T22:47:31.281ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25382025-01-13T22:47:31.281ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c6b432-bbc5-4cec-ac2d-37648dd0b7eb", "content-length": "26", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
25392025-01-13T22:47:31.281ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25402025-01-13T22:47:31.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25412025-01-13T22:47:31.316ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25422025-01-13T22:47:31.321ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25432025-01-13T22:47:31.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50def238-45b7-4694-b2bc-6a962c055f9e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
25442025-01-13T22:47:31.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50def238-45b7-4694-b2bc-6a962c055f9e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
25452025-01-13T22:47:31.456ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25462025-01-13T22:47:31.456ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25472025-01-13T22:47:31.456ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dc7f7c8-4582-472e-a25f-a102fa979e36", "content-length": "372", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
25482025-01-13T22:47:31.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25492025-01-13T22:47:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25502025-01-13T22:47:31.458ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512025-01-13T22:47:31.459ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25522025-01-13T22:47:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25532025-01-13T22:47:31.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 387.916488ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25542025-01-13T22:47:31.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25552025-01-13T22:47:31.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25562025-01-13T22:47:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25572025-01-13T22:47:31.461ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25582025-01-13T22:47:31.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25592025-01-13T22:47:31.462ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 389.927391ms iteration = 11 status = {"physical_disks_added":0}
25602025-01-13T22:47:31.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25612025-01-13T22:47:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25622025-01-13T22:47:31.463ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
25632025-01-13T22:47:31.463ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25642025-01-13T22:47:31.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50def238-45b7-4694-b2bc-6a962c055f9e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
25652025-01-13T22:47:31.463ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fac7ebc-c0c3-41af-9a67-df623963b6d9", "content-length": "26", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
25662025-01-13T22:47:31.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25672025-01-13T22:47:31.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682025-01-13T22:47:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25692025-01-13T22:47:31.464ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25702025-01-13T22:47:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25712025-01-13T22:47:31.465ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
25722025-01-13T22:47:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25732025-01-13T22:47:31.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25742025-01-13T22:47:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25752025-01-13T22:47:31.467ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25762025-01-13T22:47:31.467ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb575d73-e177-443f-90da-b0ef83edb06e", "content-length": "1", "date": "Mon, 13 Jan 2025 22:47:30 GMT"} })
25772025-01-13T22:47:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
25782025-01-13T22:47:31.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25792025-01-13T22:47:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25802025-01-13T22:47:31.469ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25812025-01-13T22:47:31.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25822025-01-13T22:47:31.469ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 397.679935ms iteration = 9 status = {}
25832025-01-13T22:47:31.472ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 399.865294ms iteration = 9 status = 0
25842025-01-13T22:47:31.472ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 400.334798ms iteration = 9 status = null
25852025-01-13T22:47:31.496ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25862025-01-13T22:47:31.496ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
25872025-01-13T22:47:31.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25882025-01-13T22:47:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25892025-01-13T22:47:31.498ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25902025-01-13T22:47:31.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 427.08527ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25912025-01-13T22:47:31.500ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25922025-01-13T22:47:31.500ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25932025-01-13T22:47:31.500ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25942025-01-13T22:47:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25952025-01-13T22:47:31.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 429.071262ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25962025-01-13T22:47:31.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 429.32942ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25972025-01-13T22:47:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25982025-01-13T22:47:31.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25992025-01-13T22:47:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26002025-01-13T22:47:31.509ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
26012025-01-13T22:47:31.509ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 437.649802ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26022025-01-13T22:47:31.510ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
26032025-01-13T22:47:31.510ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 438.470128ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26042025-01-13T22:47:31.513ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
26052025-01-13T22:47:31.513ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26062025-01-13T22:47:31.513ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
26072025-01-13T22:47:31.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 441.348189ms iteration = 5 status = {"generation":2}
26082025-01-13T22:47:31.517ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26092025-01-13T22:47:31.517ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26102025-01-13T22:47:31.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26112025-01-13T22:47:31.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26122025-01-13T22:47:31.527ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26132025-01-13T22:47:31.527ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26142025-01-13T22:47:31.527ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9754200d-bcd9-4d99-a053-078962411e29", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26152025-01-13T22:47:31.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26162025-01-13T22:47:31.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26172025-01-13T22:47:31.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26182025-01-13T22:47:31.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26192025-01-13T22:47:31.532ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26202025-01-13T22:47:31.533ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26212025-01-13T22:47:31.533ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26222025-01-13T22:47:31.533ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 460.842421ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26232025-01-13T22:47:31.533ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3cdf7dae-9073-4587-b1a9-9c7a79df3166", "date": "Mon, 13 Jan 2025 22:47:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26242025-01-13T22:47:31.533ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26252025-01-13T22:47:31.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26262025-01-13T22:47:31.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26272025-01-13T22:47:31.534ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5720a03c-141a-4ba0-9f8f-b3a7810380bd", "date": "Mon, 13 Jan 2025 22:47:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26282025-01-13T22:47:31.534ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26292025-01-13T22:47:31.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26302025-01-13T22:47:31.536ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26312025-01-13T22:47:31.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 464.069173ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26322025-01-13T22:47:31.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332025-01-13T22:47:31.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26342025-01-13T22:47:31.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26352025-01-13T22:47:31.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26362025-01-13T22:47:31.563ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26372025-01-13T22:47:31.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 491.180526ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26382025-01-13T22:47:31.625ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26392025-01-13T22:47:31.625ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4db34557-e950-4a82-9dad-1bd361a35e76", "content-length": "691", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26402025-01-13T22:47:31.625ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26412025-01-13T22:47:31.625ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26422025-01-13T22:47:31.625ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26432025-01-13T22:47:31.626ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 554.343452ms iteration = 9 status = {}
26442025-01-13T22:47:31.627ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26452025-01-13T22:47:31.627ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26462025-01-13T22:47:31.627ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
26472025-01-13T22:47:31.627ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 555.899491ms iteration = 5 status = {"generation":1}
26482025-01-13T22:47:31.628ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26492025-01-13T22:47:31.628ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26502025-01-13T22:47:31.628ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26512025-01-13T22:47:31.628ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "14c8d207-9b49-4f22-84c6-5fd38de451e7", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26522025-01-13T22:47:31.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b7eb48c6-1621-44ec-a682-b5d80471622d", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26532025-01-13T22:47:31.628ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26542025-01-13T22:47:31.630ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 557.650356ms iteration = 9 status = {}
26552025-01-13T22:47:31.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ffc995ee-90ad-40a8-8e37-898c04807a64", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26562025-01-13T22:47:31.630ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26572025-01-13T22:47:31.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3e5f226f-0e4b-463b-86ec-c9fad4874dba", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26582025-01-13T22:47:31.632ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26592025-01-13T22:47:31.634ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26602025-01-13T22:47:31.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.111006ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26612025-01-13T22:47:31.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26622025-01-13T22:47:31.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26632025-01-13T22:47:31.669ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
26642025-01-13T22:47:31.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26652025-01-13T22:47:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26662025-01-13T22:47:31.679ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26672025-01-13T22:47:31.679ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "58815317-3f90-47db-9c8f-45ec3d409f03", "content-length": "134", "date": "Mon, 13 Jan 2025 22:47:30 GMT"} })
26682025-01-13T22:47:31.679ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26692025-01-13T22:47:31.679ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
26702025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26712025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26722025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26732025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26742025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26752025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26762025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26772025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26782025-01-13T22:47:31.680ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
26792025-01-13T22:47:31.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26802025-01-13T22:47:31.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26812025-01-13T22:47:31.682ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26822025-01-13T22:47:31.683ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "982bac7b-245c-473b-bfbf-d4a3b40e6366", "content-length": "2", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26832025-01-13T22:47:31.683ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26842025-01-13T22:47:31.683ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a49221f-9353-4828-bbf7-0d90739d54e7", "content-length": "51", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26852025-01-13T22:47:31.683ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
26862025-01-13T22:47:31.683ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26872025-01-13T22:47:31.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f71c5a5-b380-44eb-beda-eaca2a84beb3", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26882025-01-13T22:47:31.770ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
26892025-01-13T22:47:31.770ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26902025-01-13T22:47:31.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "212916ca-7bba-4266-9723-a8c01191180c", "content-length": "682", "date": "Mon, 13 Jan 2025 22:47:31 GMT"} })
26912025-01-13T22:47:31.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26922025-01-13T22:47:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26932025-01-13T22:47:31.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26942025-01-13T22:47:31.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26952025-01-13T22:47:31.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26962025-01-13T22:47:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26972025-01-13T22:47:31.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26982025-01-13T22:47:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26992025-01-13T22:47:31.785ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.991451ms iteration = 9 status = {}
27002025-01-13T22:47:31.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 73a61d36-a685-4d6e-8b92-2d4c12bbf985 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27012025-01-13T22:47:31.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 73a61d36-a685-4d6e-8b92-2d4c12bbf985 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27022025-01-13T22:47:31.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 73a61d36-a685-4d6e-8b92-2d4c12bbf985 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27032025-01-13T22:47:32.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e6baf7a9-d086-43e5-9ac0-09f08959b9f4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27042025-01-13T22:47:32.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e6baf7a9-d086-43e5-9ac0-09f08959b9f4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27052025-01-13T22:47:32.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e6baf7a9-d086-43e5-9ac0-09f08959b9f4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27062025-01-13T22:47:33.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc97abd8-8543-437e-8c13-624567a1774e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27072025-01-13T22:47:33.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc97abd8-8543-437e-8c13-624567a1774e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27082025-01-13T22:47:33.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc97abd8-8543-437e-8c13-624567a1774e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27092025-01-13T22:47:33.512ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 483 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = fdaf0ac8-f0d4-408c-b790-dac86fb58ea8 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
27102025-01-13T22:47:34.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 476f8431-85a9-4577-832e-7ec214d6081c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27112025-01-13T22:47:34.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 476f8431-85a9-4577-832e-7ec214d6081c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27122025-01-13T22:47:34.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 476f8431-85a9-4577-832e-7ec214d6081c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27132025-01-13T22:47:35.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac32ff0e-8651-42cb-9b7d-ac46e72e1e63 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27142025-01-13T22:47:35.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac32ff0e-8651-42cb-9b7d-ac46e72e1e63 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27152025-01-13T22:47:35.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac32ff0e-8651-42cb-9b7d-ac46e72e1e63 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27162025-01-13T22:47:36.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46a59b4f-c6cc-447f-8316-2a847034fafe roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27172025-01-13T22:47:36.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46a59b4f-c6cc-447f-8316-2a847034fafe resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27182025-01-13T22:47:36.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46a59b4f-c6cc-447f-8316-2a847034fafe response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27192025-01-13T22:47:37.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e2727c37-1e10-4c9f-9e5b-b5872c9b6f4a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27202025-01-13T22:47:37.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e2727c37-1e10-4c9f-9e5b-b5872c9b6f4a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27212025-01-13T22:47:37.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e2727c37-1e10-4c9f-9e5b-b5872c9b6f4a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27222025-01-13T22:47:38.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4f09ffa4-faa9-4f8b-804b-d64a3a47bb85 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27232025-01-13T22:47:38.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4f09ffa4-faa9-4f8b-804b-d64a3a47bb85 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27242025-01-13T22:47:38.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4f09ffa4-faa9-4f8b-804b-d64a3a47bb85 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27252025-01-13T22:47:39.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = def3f9d4-70dc-461a-a49c-37fe74db1b6d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27262025-01-13T22:47:39.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = def3f9d4-70dc-461a-a49c-37fe74db1b6d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27272025-01-13T22:47:39.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = def3f9d4-70dc-461a-a49c-37fe74db1b6d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27282025-01-13T22:47:40.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 004adffb-79c0-4dcf-be71-c62d5de734ec roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27292025-01-13T22:47:40.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 004adffb-79c0-4dcf-be71-c62d5de734ec resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27302025-01-13T22:47:40.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 004adffb-79c0-4dcf-be71-c62d5de734ec response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27312025-01-13T22:47:41.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
27322025-01-13T22:47:41.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
27332025-01-13T22:47:41.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27342025-01-13T22:47:41.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27352025-01-13T22:47:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27362025-01-13T22:47:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27372025-01-13T22:47:41.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27382025-01-13T22:47:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27392025-01-13T22:47:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27402025-01-13T22:47:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27412025-01-13T22:47:41.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27422025-01-13T22:47:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27432025-01-13T22:47:41.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27442025-01-13T22:47:41.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27452025-01-13T22:47:41.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27462025-01-13T22:47:41.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
27472025-01-13T22:47:41.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27482025-01-13T22:47:41.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27492025-01-13T22:47:41.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
27502025-01-13T22:47:41.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.722354ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
27512025-01-13T22:47:41.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.801875ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27522025-01-13T22:47:41.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 80b06478-2789-4ced-9a24-d5eedb0efce2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27532025-01-13T22:47:41.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 80b06478-2789-4ced-9a24-d5eedb0efce2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27542025-01-13T22:47:41.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 80b06478-2789-4ced-9a24-d5eedb0efce2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27552025-01-13T22:47:42.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c938de4e-8179-4683-9c31-7c02a29ea3c6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27562025-01-13T22:47:42.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c938de4e-8179-4683-9c31-7c02a29ea3c6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27572025-01-13T22:47:42.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c938de4e-8179-4683-9c31-7c02a29ea3c6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27582025-01-13T22:47:43.512ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = e2b1ca60-4cc7-4f69-bd01-36f5593a2296 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
27592025-01-13T22:47:43.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 42f97ba5-8842-497c-944c-5b58db418d2e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27602025-01-13T22:47:43.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 42f97ba5-8842-497c-944c-5b58db418d2e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27612025-01-13T22:47:43.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 42f97ba5-8842-497c-944c-5b58db418d2e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27622025-01-13T22:47:44.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4318cc4f-11c1-4e31-9606-be66d9af511c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27632025-01-13T22:47:44.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4318cc4f-11c1-4e31-9606-be66d9af511c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27642025-01-13T22:47:44.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4318cc4f-11c1-4e31-9606-be66d9af511c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27652025-01-13T22:47:45.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9915db58-c138-44cc-9241-6100bec77905 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27662025-01-13T22:47:45.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9915db58-c138-44cc-9241-6100bec77905 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27672025-01-13T22:47:45.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9915db58-c138-44cc-9241-6100bec77905 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27682025-01-13T22:47:46.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d1a569a-f5b2-4ee9-836c-532c04fc3f01 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27692025-01-13T22:47:46.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d1a569a-f5b2-4ee9-836c-532c04fc3f01 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27702025-01-13T22:47:46.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d1a569a-f5b2-4ee9-836c-532c04fc3f01 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27712025-01-13T22:47:47.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b1de6a79-b293-4364-bcea-b0f7878c4074 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27722025-01-13T22:47:47.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b1de6a79-b293-4364-bcea-b0f7878c4074 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27732025-01-13T22:47:47.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b1de6a79-b293-4364-bcea-b0f7878c4074 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27742025-01-13T22:47:48.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94c1df9b-43e7-49a9-9dbb-9b213321445b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27752025-01-13T22:47:48.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94c1df9b-43e7-49a9-9dbb-9b213321445b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27762025-01-13T22:47:48.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94c1df9b-43e7-49a9-9dbb-9b213321445b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27772025-01-13T22:47:49.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0317e2b2-8da0-4f5d-a624-ecb117bec48e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27782025-01-13T22:47:49.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0317e2b2-8da0-4f5d-a624-ecb117bec48e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27792025-01-13T22:47:49.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0317e2b2-8da0-4f5d-a624-ecb117bec48e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27802025-01-13T22:47:50.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 03d1476f-2131-4815-9435-fb3f08bd3f8c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27812025-01-13T22:47:50.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 03d1476f-2131-4815-9435-fb3f08bd3f8c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27822025-01-13T22:47:50.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 03d1476f-2131-4815-9435-fb3f08bd3f8c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
27832025-01-13T22:47:51.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
27842025-01-13T22:47:51.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
27852025-01-13T22:47:51.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27862025-01-13T22:47:51.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27872025-01-13T22:47:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27882025-01-13T22:47:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27892025-01-13T22:47:51.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902025-01-13T22:47:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27912025-01-13T22:47:51.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27922025-01-13T22:47:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27932025-01-13T22:47:51.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27942025-01-13T22:47:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27952025-01-13T22:47:51.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27962025-01-13T22:47:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27972025-01-13T22:47:51.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.683639ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27982025-01-13T22:47:51.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992025-01-13T22:47:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
28002025-01-13T22:47:51.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28012025-01-13T22:47:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28022025-01-13T22:47:51.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
28032025-01-13T22:47:51.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.064592ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
28042025-01-13T22:47:51.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dd7dfa90-3208-44b5-8af1-deacad513eb2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28052025-01-13T22:47:51.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dd7dfa90-3208-44b5-8af1-deacad513eb2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28062025-01-13T22:47:51.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dd7dfa90-3208-44b5-8af1-deacad513eb2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28072025-01-13T22:47:52.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 019c64cf-9fa0-46aa-90dd-67b9fe82d58d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28082025-01-13T22:47:52.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 019c64cf-9fa0-46aa-90dd-67b9fe82d58d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28092025-01-13T22:47:52.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 019c64cf-9fa0-46aa-90dd-67b9fe82d58d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28102025-01-13T22:47:53.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 505 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 30edfb6b-f94f-427a-85ce-d0c9ece30e98 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
28112025-01-13T22:47:53.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0e38cb1b-df06-4edd-bde9-3ada016eed10 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28122025-01-13T22:47:53.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0e38cb1b-df06-4edd-bde9-3ada016eed10 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28132025-01-13T22:47:53.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0e38cb1b-df06-4edd-bde9-3ada016eed10 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28142025-01-13T22:47:54.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 00c74524-d0ea-472a-a93f-93f76f4e3cdd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28152025-01-13T22:47:54.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 00c74524-d0ea-472a-a93f-93f76f4e3cdd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28162025-01-13T22:47:54.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 00c74524-d0ea-472a-a93f-93f76f4e3cdd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28172025-01-13T22:47:55.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8e2b4598-4e9f-4584-9099-5bc8d555bcc5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28182025-01-13T22:47:55.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8e2b4598-4e9f-4584-9099-5bc8d555bcc5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28192025-01-13T22:47:55.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8e2b4598-4e9f-4584-9099-5bc8d555bcc5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28202025-01-13T22:47:57.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d093bf9-48a5-4720-a2fa-9eb736869e70 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28212025-01-13T22:47:57.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d093bf9-48a5-4720-a2fa-9eb736869e70 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28222025-01-13T22:47:57.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d093bf9-48a5-4720-a2fa-9eb736869e70 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28232025-01-13T22:47:58.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5759d830-c074-48c9-a5a1-ae2a4736021e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28242025-01-13T22:47:58.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5759d830-c074-48c9-a5a1-ae2a4736021e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28252025-01-13T22:47:58.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5759d830-c074-48c9-a5a1-ae2a4736021e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28262025-01-13T22:47:58.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 66436d31-0e21-4ecd-b9f3-817eb4181c7c roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
28272025-01-13T22:47:58.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 66436d31-0e21-4ecd-b9f3-817eb4181c7c resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
28282025-01-13T22:47:58.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 66436d31-0e21-4ecd-b9f3-817eb4181c7c response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
28292025-01-13T22:47:58.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 80c1b145-7bcb-4e8c-8d1c-53ac3dd32a52 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
28302025-01-13T22:47:58.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 80c1b145-7bcb-4e8c-8d1c-53ac3dd32a52 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
28312025-01-13T22:47:58.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 80c1b145-7bcb-4e8c-8d1c-53ac3dd32a52 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
28322025-01-13T22:47:59.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3ad1511-5c0e-4605-9b4b-7ddf65a0a14e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28332025-01-13T22:47:59.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3ad1511-5c0e-4605-9b4b-7ddf65a0a14e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28342025-01-13T22:47:59.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3ad1511-5c0e-4605-9b4b-7ddf65a0a14e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28352025-01-13T22:48:00.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 927f2bcd-db71-423e-a99f-71e65830a1d6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28362025-01-13T22:48:00.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 927f2bcd-db71-423e-a99f-71e65830a1d6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28372025-01-13T22:48:00.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 927f2bcd-db71-423e-a99f-71e65830a1d6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
28382025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
28392025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
28402025-01-13T22:48:01.072ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28412025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
28422025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28432025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28442025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28452025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
28462025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
28472025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28482025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28492025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
28502025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
28512025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28522025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28532025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
28542025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28552025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
28562025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28572025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
28582025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
28592025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28602025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
28612025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28622025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
28632025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
28642025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28652025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28662025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
28672025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28682025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28692025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
28702025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
28712025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28722025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28732025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
28742025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28752025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28762025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28772025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28782025-01-13T22:48:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28792025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28802025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28812025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28822025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28832025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28842025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28852025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28862025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28872025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28882025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28892025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28902025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28912025-01-13T22:48:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28922025-01-13T22:48:01.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28932025-01-13T22:48:01.075ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28942025-01-13T22:48:01.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2940, tv_nsec: 699905837 } })
28952025-01-13T22:48:01.076ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.992955ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28962025-01-13T22:48:01.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
28972025-01-13T22:48:01.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28982025-01-13T22:48:01.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28992025-01-13T22:48:01.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29002025-01-13T22:48:01.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29012025-01-13T22:48:01.078ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29022025-01-13T22:48:01.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29032025-01-13T22:48:01.081ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2940, tv_nsec: 704820392 } })
29042025-01-13T22:48:01.081ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29052025-01-13T22:48:01.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062025-01-13T22:48:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29072025-01-13T22:48:01.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29082025-01-13T22:48:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29092025-01-13T22:48:01.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2940, tv_nsec: 713550846 } })
29102025-01-13T22:48:01.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
29112025-01-13T22:48:01.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29122025-01-13T22:48:01.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29132025-01-13T22:48:01.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 11fabe82-2082-41dd-9d01-ab83c3619560 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
29142025-01-13T22:48:01.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 11fabe82-2082-41dd-9d01-ab83c3619560 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
29152025-01-13T22:48:01.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 11fabe82-2082-41dd-9d01-ab83c3619560 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
29162025-01-13T22:48:01.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29172025-01-13T22:48:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29182025-01-13T22:48:01.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29192025-01-13T22:48:01.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29202025-01-13T22:48:01.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29212025-01-13T22:48:01.124ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29222025-01-13T22:48:01.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29232025-01-13T22:48:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29242025-01-13T22:48:01.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29252025-01-13T22:48:01.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29262025-01-13T22:48:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29272025-01-13T22:48:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29282025-01-13T22:48:01.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29292025-01-13T22:48:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29302025-01-13T22:48:01.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.534467ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
29312025-01-13T22:48:01.129ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29322025-01-13T22:48:01.129ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29332025-01-13T22:48:01.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29342025-01-13T22:48:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29352025-01-13T22:48:01.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29362025-01-13T22:48:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29372025-01-13T22:48:01.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29382025-01-13T22:48:01.132ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29392025-01-13T22:48:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29402025-01-13T22:48:01.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.276755ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
29412025-01-13T22:48:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29422025-01-13T22:48:01.134ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29432025-01-13T22:48:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29442025-01-13T22:48:01.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29452025-01-13T22:48:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29462025-01-13T22:48:01.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29472025-01-13T22:48:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29482025-01-13T22:48:01.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29492025-01-13T22:48:01.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29502025-01-13T22:48:01.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29512025-01-13T22:48:01.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29522025-01-13T22:48:01.143ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29532025-01-13T22:48:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
29542025-01-13T22:48:01.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29552025-01-13T22:48:01.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29562025-01-13T22:48:01.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.041704ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29572025-01-13T22:48:01.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29582025-01-13T22:48:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29592025-01-13T22:48:01.162ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
29602025-01-13T22:48:01.162ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.401712ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
29612025-01-13T22:48:01.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.888428ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29622025-01-13T22:48:01.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29632025-01-13T22:48:01.165ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29642025-01-13T22:48:01.166ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a568f260-4239-4aa5-b31d-387b6b8f0960", "content-length": "26", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
29652025-01-13T22:48:01.166ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29662025-01-13T22:48:01.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29672025-01-13T22:48:01.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29682025-01-13T22:48:01.168ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29692025-01-13T22:48:01.168ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29702025-01-13T22:48:01.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29712025-01-13T22:48:01.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29722025-01-13T22:48:01.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29732025-01-13T22:48:01.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29742025-01-13T22:48:01.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29752025-01-13T22:48:01.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762025-01-13T22:48:01.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29772025-01-13T22:48:01.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29782025-01-13T22:48:01.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29792025-01-13T22:48:01.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29802025-01-13T22:48:01.171ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29812025-01-13T22:48:01.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29822025-01-13T22:48:01.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29832025-01-13T22:48:01.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29842025-01-13T22:48:01.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29852025-01-13T22:48:01.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29862025-01-13T22:48:01.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29872025-01-13T22:48:01.173ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
29882025-01-13T22:48:01.173ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 101.070288ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
29892025-01-13T22:48:01.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902025-01-13T22:48:01.176ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29912025-01-13T22:48:01.176ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.787304ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29922025-01-13T22:48:01.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
29932025-01-13T22:48:01.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29942025-01-13T22:48:01.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29952025-01-13T22:48:01.178ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.778906ms iteration = 10 status = 0
29962025-01-13T22:48:01.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.006585ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29972025-01-13T22:48:01.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29982025-01-13T22:48:01.179ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29992025-01-13T22:48:01.180ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8156aef0-a035-4007-a947-4fc5b4907240", "content-length": "26", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30002025-01-13T22:48:01.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30012025-01-13T22:48:01.181ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30022025-01-13T22:48:01.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.615401ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30032025-01-13T22:48:01.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
30042025-01-13T22:48:01.196ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30052025-01-13T22:48:01.196ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f7a95d8-1766-4840-badb-516470c7e5df", "content-length": "26", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30062025-01-13T22:48:01.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30072025-01-13T22:48:01.198ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
30082025-01-13T22:48:01.200ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30092025-01-13T22:48:01.200ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30102025-01-13T22:48:01.200ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.812839ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30112025-01-13T22:48:01.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30122025-01-13T22:48:01.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30132025-01-13T22:48:01.265ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 193.080572ms iteration = 10 status = {}
30142025-01-13T22:48:01.270ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30152025-01-13T22:48:01.270ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ad089db-e6b2-4e74-bb81-fd40ec8dd209", "content-length": "1", "date": "Mon, 13 Jan 2025 22:48:00 GMT"} })
30162025-01-13T22:48:01.271ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30172025-01-13T22:48:01.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30182025-01-13T22:48:01.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.754745ms iteration = 12 status = {"physical_disks_added":0}
30192025-01-13T22:48:01.274ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.005882ms iteration = 10 status = null
30202025-01-13T22:48:01.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30212025-01-13T22:48:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30222025-01-13T22:48:01.312ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30232025-01-13T22:48:01.312ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30242025-01-13T22:48:01.313ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e47a03a9-57a7-4467-b0ae-ad6528e661ca", "content-length": "372", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30252025-01-13T22:48:01.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30262025-01-13T22:48:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30272025-01-13T22:48:01.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30282025-01-13T22:48:01.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30292025-01-13T22:48:01.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30302025-01-13T22:48:01.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30312025-01-13T22:48:01.355ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30322025-01-13T22:48:01.355ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30332025-01-13T22:48:01.355ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4549b15e-febd-43ec-9340-a2e729247907", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30342025-01-13T22:48:01.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30352025-01-13T22:48:01.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30362025-01-13T22:48:01.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30372025-01-13T22:48:01.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30382025-01-13T22:48:01.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30392025-01-13T22:48:01.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30402025-01-13T22:48:01.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30412025-01-13T22:48:01.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30422025-01-13T22:48:01.366ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30432025-01-13T22:48:01.366ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30442025-01-13T22:48:01.366ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "54629998-2530-4b86-b1f2-c4aa04d41f1b", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30452025-01-13T22:48:01.367ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.163192ms iteration = 10 status = {}
30462025-01-13T22:48:01.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
30472025-01-13T22:48:01.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30482025-01-13T22:48:01.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30492025-01-13T22:48:01.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30502025-01-13T22:48:01.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4c710bc-1ee4-4d5e-b120-14f40de9004f", "content-length": "134", "date": "Mon, 13 Jan 2025 22:48:00 GMT"} })
30512025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30522025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
30532025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30542025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30552025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30562025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30572025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30582025-01-13T22:48:01.377ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30592025-01-13T22:48:01.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602025-01-13T22:48:01.378ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30612025-01-13T22:48:01.378ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30622025-01-13T22:48:01.378ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
30632025-01-13T22:48:01.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30642025-01-13T22:48:01.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30652025-01-13T22:48:01.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30662025-01-13T22:48:01.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30672025-01-13T22:48:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30682025-01-13T22:48:01.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30692025-01-13T22:48:01.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae5a91ea-1a43-47cb-b824-8cfc1e197ac0", "content-length": "2", "date": "Mon, 13 Jan 2025 22:48:00 GMT"} })
30702025-01-13T22:48:01.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30712025-01-13T22:48:01.381ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "63a6de74-2cd8-4fff-b795-9005a82a7554", "content-length": "51", "date": "Mon, 13 Jan 2025 22:48:00 GMT"} })
30722025-01-13T22:48:01.381ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
30732025-01-13T22:48:01.381ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30742025-01-13T22:48:01.415ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30752025-01-13T22:48:01.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b9c3db59-91d1-47aa-b655-baaa157230b2", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30762025-01-13T22:48:01.483ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
30772025-01-13T22:48:01.483ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30782025-01-13T22:48:01.484ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "564e555e-ce1e-4a64-88ad-3e166ccf267e", "content-length": "691", "date": "Mon, 13 Jan 2025 22:48:01 GMT"} })
30792025-01-13T22:48:01.484ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30802025-01-13T22:48:01.484ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30812025-01-13T22:48:01.484ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30822025-01-13T22:48:01.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d6dcdc6-3c28-4f08-8799-333d75e24749", "content-length": "682", "date": "Mon, 13 Jan 2025 22:48:00 GMT"} })
30832025-01-13T22:48:01.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30842025-01-13T22:48:01.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30852025-01-13T22:48:01.485ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.277026ms iteration = 10 status = {}
30862025-01-13T22:48:01.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30872025-01-13T22:48:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30882025-01-13T22:48:01.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30892025-01-13T22:48:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30902025-01-13T22:48:01.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30912025-01-13T22:48:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30922025-01-13T22:48:01.500ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 428.208235ms iteration = 10 status = {}
30932025-01-13T22:48:01.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 2f05e311-2780-4ad9-a3ee-4960793462fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30942025-01-13T22:48:01.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 2f05e311-2780-4ad9-a3ee-4960793462fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30952025-01-13T22:48:01.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 2f05e311-2780-4ad9-a3ee-4960793462fd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30962025-01-13T22:48:02.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 942d0fbe-bb6f-4840-99b3-cd4418f693de roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
30972025-01-13T22:48:02.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 942d0fbe-bb6f-4840-99b3-cd4418f693de resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
30982025-01-13T22:48:02.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 942d0fbe-bb6f-4840-99b3-cd4418f693de response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
30992025-01-13T22:48:03.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 83ac6ff0-75bc-4d33-97fc-25f9c5569011 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31002025-01-13T22:48:03.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 83ac6ff0-75bc-4d33-97fc-25f9c5569011 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31012025-01-13T22:48:03.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 83ac6ff0-75bc-4d33-97fc-25f9c5569011 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31022025-01-13T22:48:03.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = e6ad44b1-52cf-42e7-9291-94834bb88be2 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
31032025-01-13T22:48:04.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6505dd2d-2687-4b44-9091-f22cf2337be5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31042025-01-13T22:48:04.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6505dd2d-2687-4b44-9091-f22cf2337be5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31052025-01-13T22:48:04.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6505dd2d-2687-4b44-9091-f22cf2337be5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31062025-01-13T22:48:05.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f7b5c18d-022e-445e-aac8-085960d27f58 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31072025-01-13T22:48:05.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f7b5c18d-022e-445e-aac8-085960d27f58 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31082025-01-13T22:48:05.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f7b5c18d-022e-445e-aac8-085960d27f58 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31092025-01-13T22:48:06.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dc2a658-f89c-429b-80d0-995e39dfdc00 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31102025-01-13T22:48:06.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dc2a658-f89c-429b-80d0-995e39dfdc00 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31112025-01-13T22:48:06.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dc2a658-f89c-429b-80d0-995e39dfdc00 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31122025-01-13T22:48:07.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 041b3c85-6db1-4b08-9cc7-6f3c3e106358 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31132025-01-13T22:48:07.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 041b3c85-6db1-4b08-9cc7-6f3c3e106358 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31142025-01-13T22:48:07.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 041b3c85-6db1-4b08-9cc7-6f3c3e106358 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31152025-01-13T22:48:08.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59738ce0-36a6-4088-afc4-63c9362bb9b3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31162025-01-13T22:48:08.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59738ce0-36a6-4088-afc4-63c9362bb9b3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31172025-01-13T22:48:08.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59738ce0-36a6-4088-afc4-63c9362bb9b3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31182025-01-13T22:48:09.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 899a1091-d834-46c0-a443-7106d4dff6d1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31192025-01-13T22:48:09.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 899a1091-d834-46c0-a443-7106d4dff6d1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31202025-01-13T22:48:09.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 899a1091-d834-46c0-a443-7106d4dff6d1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31212025-01-13T22:48:10.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b947e600-60bb-44e3-bfde-5cf6a4373642 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31222025-01-13T22:48:10.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b947e600-60bb-44e3-bfde-5cf6a4373642 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31232025-01-13T22:48:10.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b947e600-60bb-44e3-bfde-5cf6a4373642 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31242025-01-13T22:48:11.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
31252025-01-13T22:48:11.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31262025-01-13T22:48:11.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
31272025-01-13T22:48:11.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31282025-01-13T22:48:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31292025-01-13T22:48:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31302025-01-13T22:48:11.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31312025-01-13T22:48:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31322025-01-13T22:48:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31332025-01-13T22:48:11.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.396758ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31342025-01-13T22:48:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31352025-01-13T22:48:11.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31362025-01-13T22:48:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31372025-01-13T22:48:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31382025-01-13T22:48:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31392025-01-13T22:48:11.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31402025-01-13T22:48:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
31412025-01-13T22:48:11.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31422025-01-13T22:48:11.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31432025-01-13T22:48:11.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
31442025-01-13T22:48:11.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.757043ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
31452025-01-13T22:48:11.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ae904aa-5973-464e-a157-ca8de34b119a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31462025-01-13T22:48:11.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ae904aa-5973-464e-a157-ca8de34b119a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31472025-01-13T22:48:11.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ae904aa-5973-464e-a157-ca8de34b119a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31482025-01-13T22:48:12.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a951c73b-80f3-4d2a-8036-16dc3b52a0c4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31492025-01-13T22:48:12.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a951c73b-80f3-4d2a-8036-16dc3b52a0c4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31502025-01-13T22:48:12.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a951c73b-80f3-4d2a-8036-16dc3b52a0c4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31512025-01-13T22:48:13.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f8d6476-25fa-4e0e-8f81-61362226ccac roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31522025-01-13T22:48:13.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f8d6476-25fa-4e0e-8f81-61362226ccac resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31532025-01-13T22:48:13.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f8d6476-25fa-4e0e-8f81-61362226ccac response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31542025-01-13T22:48:13.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 2dc44902-4503-4eb2-a4a6-4973506b512c response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
31552025-01-13T22:48:14.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dde851d-5f58-4ca0-8c04-5a4ad0f49a46 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31562025-01-13T22:48:14.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dde851d-5f58-4ca0-8c04-5a4ad0f49a46 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31572025-01-13T22:48:14.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dde851d-5f58-4ca0-8c04-5a4ad0f49a46 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31582025-01-13T22:48:15.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70f80276-659b-4687-8c5b-da698537689a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31592025-01-13T22:48:15.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70f80276-659b-4687-8c5b-da698537689a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31602025-01-13T22:48:15.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70f80276-659b-4687-8c5b-da698537689a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31612025-01-13T22:48:16.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46dce1bf-2ae4-4858-a346-7592e1f17d44 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31622025-01-13T22:48:16.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46dce1bf-2ae4-4858-a346-7592e1f17d44 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31632025-01-13T22:48:16.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46dce1bf-2ae4-4858-a346-7592e1f17d44 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31642025-01-13T22:48:17.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b912468b-6816-4d78-9206-24bd237965c5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31652025-01-13T22:48:17.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b912468b-6816-4d78-9206-24bd237965c5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31662025-01-13T22:48:17.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b912468b-6816-4d78-9206-24bd237965c5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31672025-01-13T22:48:18.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b7c0f588-6c02-4dba-838b-83a22c29e3c1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31682025-01-13T22:48:18.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b7c0f588-6c02-4dba-838b-83a22c29e3c1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31692025-01-13T22:48:18.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b7c0f588-6c02-4dba-838b-83a22c29e3c1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31702025-01-13T22:48:19.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 90eee4be-0b7b-4903-8bb0-82f47a6e9613 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31712025-01-13T22:48:19.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 90eee4be-0b7b-4903-8bb0-82f47a6e9613 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31722025-01-13T22:48:19.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 90eee4be-0b7b-4903-8bb0-82f47a6e9613 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31732025-01-13T22:48:20.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 57f790b7-0c16-4a7e-aedb-78ba471a8795 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31742025-01-13T22:48:20.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 57f790b7-0c16-4a7e-aedb-78ba471a8795 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31752025-01-13T22:48:20.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 57f790b7-0c16-4a7e-aedb-78ba471a8795 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31762025-01-13T22:48:21.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
31772025-01-13T22:48:21.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
31782025-01-13T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31792025-01-13T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31802025-01-13T22:48:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31812025-01-13T22:48:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31822025-01-13T22:48:21.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31832025-01-13T22:48:21.075ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31842025-01-13T22:48:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31852025-01-13T22:48:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31862025-01-13T22:48:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31872025-01-13T22:48:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31882025-01-13T22:48:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31892025-01-13T22:48:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31902025-01-13T22:48:21.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912025-01-13T22:48:21.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
31922025-01-13T22:48:21.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31932025-01-13T22:48:21.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31942025-01-13T22:48:21.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
31952025-01-13T22:48:21.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.105901ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
31962025-01-13T22:48:21.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.400599ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31972025-01-13T22:48:21.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 34afde9a-2ec9-4c95-a9c6-32c7723af235 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31982025-01-13T22:48:21.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 34afde9a-2ec9-4c95-a9c6-32c7723af235 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
31992025-01-13T22:48:21.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 34afde9a-2ec9-4c95-a9c6-32c7723af235 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32002025-01-13T22:48:22.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3dfa393e-d754-40d4-ae27-9fc89198684b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32012025-01-13T22:48:22.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3dfa393e-d754-40d4-ae27-9fc89198684b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32022025-01-13T22:48:22.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3dfa393e-d754-40d4-ae27-9fc89198684b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32032025-01-13T22:48:23.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = fec706da-8756-4677-ac68-de0a415f8df2 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
32042025-01-13T22:48:23.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac05f7c7-339f-4226-b580-547eb9789419 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32052025-01-13T22:48:23.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac05f7c7-339f-4226-b580-547eb9789419 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32062025-01-13T22:48:23.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac05f7c7-339f-4226-b580-547eb9789419 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32072025-01-13T22:48:24.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d1b5c09-62ad-405b-b48b-c9e66c4df2e2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32082025-01-13T22:48:24.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d1b5c09-62ad-405b-b48b-c9e66c4df2e2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32092025-01-13T22:48:24.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d1b5c09-62ad-405b-b48b-c9e66c4df2e2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32102025-01-13T22:48:25.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 110edab9-a9a5-4e87-9c2e-8822b8e45b54 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32112025-01-13T22:48:25.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 110edab9-a9a5-4e87-9c2e-8822b8e45b54 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32122025-01-13T22:48:25.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 110edab9-a9a5-4e87-9c2e-8822b8e45b54 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32132025-01-13T22:48:26.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5d037da3-dc45-4198-87a4-405ec2d5016f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32142025-01-13T22:48:26.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5d037da3-dc45-4198-87a4-405ec2d5016f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32152025-01-13T22:48:26.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5d037da3-dc45-4198-87a4-405ec2d5016f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32162025-01-13T22:48:27.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec3a6a00-bdb0-4398-9255-1f4c925a6081 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32172025-01-13T22:48:27.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec3a6a00-bdb0-4398-9255-1f4c925a6081 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32182025-01-13T22:48:27.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec3a6a00-bdb0-4398-9255-1f4c925a6081 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32192025-01-13T22:48:28.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 801b13fc-fcaa-42cc-a856-57ec0ad05db4 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
32202025-01-13T22:48:28.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 801b13fc-fcaa-42cc-a856-57ec0ad05db4 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
32212025-01-13T22:48:28.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 801b13fc-fcaa-42cc-a856-57ec0ad05db4 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
32222025-01-13T22:48:28.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 58540289-e179-46b2-b1c3-f41cef373546 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
32232025-01-13T22:48:28.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 58540289-e179-46b2-b1c3-f41cef373546 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
32242025-01-13T22:48:28.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 58540289-e179-46b2-b1c3-f41cef373546 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
32252025-01-13T22:48:28.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3d273d5f-7b3e-47a8-a782-aef3d892df69 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32262025-01-13T22:48:28.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3d273d5f-7b3e-47a8-a782-aef3d892df69 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32272025-01-13T22:48:28.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3d273d5f-7b3e-47a8-a782-aef3d892df69 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32282025-01-13T22:48:29.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6feb7b10-8cf3-48d7-bd5b-48dbd106284f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32292025-01-13T22:48:29.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6feb7b10-8cf3-48d7-bd5b-48dbd106284f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32302025-01-13T22:48:29.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6feb7b10-8cf3-48d7-bd5b-48dbd106284f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32312025-01-13T22:48:30.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fede003-e0bf-4632-b108-0b3829e11c50 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32322025-01-13T22:48:30.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fede003-e0bf-4632-b108-0b3829e11c50 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32332025-01-13T22:48:30.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fede003-e0bf-4632-b108-0b3829e11c50 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
32342025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
32352025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
32362025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32372025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
32382025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32392025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32402025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
32412025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32422025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
32432025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32442025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
32452025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
32462025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
32472025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
32482025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32492025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
32502025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32512025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32522025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
32532025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
32542025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32552025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32562025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
32572025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
32582025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32592025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32602025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
32612025-01-13T22:48:31.071ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:38:31.071382931 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32622025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
32632025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32642025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
32652025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32662025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
32672025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
32682025-01-13T22:48:31.071ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
32692025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
32702025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32712025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32722025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
32732025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32742025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32752025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32762025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
32772025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
32782025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32792025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32802025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
32812025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32822025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
32832025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32842025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
32852025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32862025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32872025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
32882025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
32892025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32902025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32912025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
32922025-01-13T22:48:31.071ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32932025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32942025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
32952025-01-13T22:48:31.071ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32962025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32972025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
32982025-01-13T22:48:31.071ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
32992025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
33002025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.37\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
33012025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33022025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33032025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33042025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33052025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33062025-01-13T22:48:31.071ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2970, tv_nsec: 695878861 } })
33072025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33082025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33092025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33102025-01-13T22:48:31.071ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2970, tv_nsec: 695920122 } })
33112025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33122025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33132025-01-13T22:48:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33142025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33152025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33162025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33172025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33182025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33192025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33202025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33212025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33222025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33232025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33242025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33252025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33262025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33272025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33282025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33292025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33302025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.144216ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33312025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
33322025-01-13T22:48:31.072ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.251139ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
33332025-01-13T22:48:31.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33342025-01-13T22:48:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33352025-01-13T22:48:31.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33362025-01-13T22:48:31.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33372025-01-13T22:48:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33382025-01-13T22:48:31.075ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.790209ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33392025-01-13T22:48:31.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33402025-01-13T22:48:31.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33412025-01-13T22:48:31.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33422025-01-13T22:48:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33432025-01-13T22:48:31.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33442025-01-13T22:48:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33452025-01-13T22:48:31.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33462025-01-13T22:48:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33472025-01-13T22:48:31.078ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2970, tv_nsec: 702820959 } })
33482025-01-13T22:48:31.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2970, tv_nsec: 703094107 } })
33492025-01-13T22:48:31.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
33502025-01-13T22:48:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33512025-01-13T22:48:31.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33522025-01-13T22:48:31.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33532025-01-13T22:48:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33542025-01-13T22:48:31.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33552025-01-13T22:48:31.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33562025-01-13T22:48:31.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33572025-01-13T22:48:31.082ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:38:31.071382931 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33582025-01-13T22:48:31.082ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.201293ms iteration = 6 status = {"expiration":"2025-01-13T22:38:31.071382931Z","pruned":[]}
33592025-01-13T22:48:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
33602025-01-13T22:48:31.083ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33612025-01-13T22:48:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33622025-01-13T22:48:31.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33632025-01-13T22:48:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33642025-01-13T22:48:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33652025-01-13T22:48:31.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33662025-01-13T22:48:31.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33672025-01-13T22:48:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33682025-01-13T22:48:31.084ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.422051ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
33692025-01-13T22:48:31.085ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33702025-01-13T22:48:31.085ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33712025-01-13T22:48:31.085ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.467845ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33722025-01-13T22:48:31.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33732025-01-13T22:48:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33742025-01-13T22:48:31.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33752025-01-13T22:48:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33762025-01-13T22:48:31.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.977402ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
33772025-01-13T22:48:31.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33782025-01-13T22:48:31.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33792025-01-13T22:48:31.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33802025-01-13T22:48:31.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33812025-01-13T22:48:31.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33822025-01-13T22:48:31.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33832025-01-13T22:48:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33842025-01-13T22:48:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33852025-01-13T22:48:31.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33862025-01-13T22:48:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33872025-01-13T22:48:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33882025-01-13T22:48:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33892025-01-13T22:48:31.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33902025-01-13T22:48:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33912025-01-13T22:48:31.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33922025-01-13T22:48:31.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33932025-01-13T22:48:31.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33942025-01-13T22:48:31.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33952025-01-13T22:48:31.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33962025-01-13T22:48:31.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33972025-01-13T22:48:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33982025-01-13T22:48:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33992025-01-13T22:48:31.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34002025-01-13T22:48:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34012025-01-13T22:48:31.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34022025-01-13T22:48:31.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34032025-01-13T22:48:31.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34042025-01-13T22:48:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34052025-01-13T22:48:31.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34062025-01-13T22:48:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34072025-01-13T22:48:31.113ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34082025-01-13T22:48:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34092025-01-13T22:48:31.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.197815ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
34102025-01-13T22:48:31.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34112025-01-13T22:48:31.126ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34122025-01-13T22:48:31.126ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34132025-01-13T22:48:31.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34142025-01-13T22:48:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34152025-01-13T22:48:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34162025-01-13T22:48:31.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34172025-01-13T22:48:31.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34182025-01-13T22:48:31.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192025-01-13T22:48:31.135ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202025-01-13T22:48:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34212025-01-13T22:48:31.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34222025-01-13T22:48:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34232025-01-13T22:48:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34242025-01-13T22:48:31.138ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34252025-01-13T22:48:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34262025-01-13T22:48:31.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34272025-01-13T22:48:31.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34282025-01-13T22:48:31.140ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34292025-01-13T22:48:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34302025-01-13T22:48:31.142ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2970, tv_nsec: 766032607 } })
34312025-01-13T22:48:31.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.707893ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34322025-01-13T22:48:31.142ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
34332025-01-13T22:48:31.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.25195ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34342025-01-13T22:48:31.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352025-01-13T22:48:31.144ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34362025-01-13T22:48:31.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34372025-01-13T22:48:31.144ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34382025-01-13T22:48:31.144ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34392025-01-13T22:48:31.144ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34402025-01-13T22:48:31.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34412025-01-13T22:48:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34422025-01-13T22:48:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
34432025-01-13T22:48:31.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34442025-01-13T22:48:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34452025-01-13T22:48:31.148ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34462025-01-13T22:48:31.148ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34472025-01-13T22:48:31.148ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34482025-01-13T22:48:31.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34492025-01-13T22:48:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34502025-01-13T22:48:31.149ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34512025-01-13T22:48:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34522025-01-13T22:48:31.149ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532025-01-13T22:48:31.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34542025-01-13T22:48:31.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34552025-01-13T22:48:31.151ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34562025-01-13T22:48:31.151ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.550862ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34572025-01-13T22:48:31.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34582025-01-13T22:48:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34592025-01-13T22:48:31.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602025-01-13T22:48:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34612025-01-13T22:48:31.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622025-01-13T22:48:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34632025-01-13T22:48:31.152ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34642025-01-13T22:48:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34652025-01-13T22:48:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34662025-01-13T22:48:31.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34672025-01-13T22:48:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34682025-01-13T22:48:31.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34692025-01-13T22:48:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34702025-01-13T22:48:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34712025-01-13T22:48:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
34722025-01-13T22:48:31.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34732025-01-13T22:48:31.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34742025-01-13T22:48:31.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34752025-01-13T22:48:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34762025-01-13T22:48:31.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34772025-01-13T22:48:31.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34782025-01-13T22:48:31.161ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34792025-01-13T22:48:31.161ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34802025-01-13T22:48:31.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34812025-01-13T22:48:31.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34822025-01-13T22:48:31.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832025-01-13T22:48:31.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842025-01-13T22:48:31.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34852025-01-13T22:48:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34862025-01-13T22:48:31.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872025-01-13T22:48:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
34882025-01-13T22:48:31.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34892025-01-13T22:48:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
34902025-01-13T22:48:31.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34912025-01-13T22:48:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34922025-01-13T22:48:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34932025-01-13T22:48:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34942025-01-13T22:48:31.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34952025-01-13T22:48:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34962025-01-13T22:48:31.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972025-01-13T22:48:31.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34982025-01-13T22:48:31.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34992025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35002025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35012025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.744995ms iteration = 11 status = 0
35022025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35032025-01-13T22:48:31.170ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35042025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35052025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35062025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35072025-01-13T22:48:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35082025-01-13T22:48:31.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35092025-01-13T22:48:31.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35102025-01-13T22:48:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35112025-01-13T22:48:31.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35122025-01-13T22:48:31.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35132025-01-13T22:48:31.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.529305ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35142025-01-13T22:48:31.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35152025-01-13T22:48:31.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35162025-01-13T22:48:31.177ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
35172025-01-13T22:48:31.177ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.039004ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
35182025-01-13T22:48:31.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35192025-01-13T22:48:31.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35202025-01-13T22:48:31.179ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35212025-01-13T22:48:31.179ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35222025-01-13T22:48:31.179ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
35232025-01-13T22:48:31.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 108.673737ms iteration = 6 status = {"generation":1}
35242025-01-13T22:48:31.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35252025-01-13T22:48:31.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35262025-01-13T22:48:31.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35272025-01-13T22:48:31.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35282025-01-13T22:48:31.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35292025-01-13T22:48:31.186ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.80424ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35302025-01-13T22:48:31.187ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35312025-01-13T22:48:31.187ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35322025-01-13T22:48:31.187ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.655827ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35332025-01-13T22:48:31.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35342025-01-13T22:48:31.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35352025-01-13T22:48:31.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35362025-01-13T22:48:31.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35372025-01-13T22:48:31.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35382025-01-13T22:48:31.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35392025-01-13T22:48:31.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35402025-01-13T22:48:31.194ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35412025-01-13T22:48:31.194ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
35422025-01-13T22:48:31.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35432025-01-13T22:48:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35442025-01-13T22:48:31.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35452025-01-13T22:48:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35462025-01-13T22:48:31.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472025-01-13T22:48:31.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35482025-01-13T22:48:31.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35492025-01-13T22:48:31.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35502025-01-13T22:48:31.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35512025-01-13T22:48:31.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35522025-01-13T22:48:31.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35532025-01-13T22:48:31.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35542025-01-13T22:48:31.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35552025-01-13T22:48:31.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35562025-01-13T22:48:31.201ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
35572025-01-13T22:48:31.201ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35582025-01-13T22:48:31.201ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
35592025-01-13T22:48:31.201ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 130.110841ms iteration = 6 status = {"generation":2}
35602025-01-13T22:48:31.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35612025-01-13T22:48:31.203ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
35622025-01-13T22:48:31.203ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.901557ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
35632025-01-13T22:48:31.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
35642025-01-13T22:48:31.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35652025-01-13T22:48:31.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35662025-01-13T22:48:31.207ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35672025-01-13T22:48:31.207ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35682025-01-13T22:48:31.207ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.844991ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35692025-01-13T22:48:31.214ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
35702025-01-13T22:48:31.214ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 143.135961ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35712025-01-13T22:48:31.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35722025-01-13T22:48:31.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35732025-01-13T22:48:31.232ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35742025-01-13T22:48:31.232ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 161.463857ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35752025-01-13T22:48:31.239ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.812717ms iteration = 13 status = {"physical_disks_added":0}
35762025-01-13T22:48:31.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
35772025-01-13T22:48:31.318ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35782025-01-13T22:48:31.319ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d215d653-8b62-4d63-9bd6-20cfa1b3d728", "content-length": "26", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
35792025-01-13T22:48:31.319ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35802025-01-13T22:48:31.321ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
35812025-01-13T22:48:31.325ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35822025-01-13T22:48:31.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35832025-01-13T22:48:31.353ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35842025-01-13T22:48:31.353ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35852025-01-13T22:48:31.353ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ea5c7a5-87bb-45f5-860a-7947c966000a", "content-length": "26", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
35862025-01-13T22:48:31.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35872025-01-13T22:48:31.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35882025-01-13T22:48:31.365ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35892025-01-13T22:48:31.365ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35902025-01-13T22:48:31.365ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "489fb26d-017b-4edd-bf70-124e2517be43", "content-length": "372", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
35912025-01-13T22:48:31.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35922025-01-13T22:48:31.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35932025-01-13T22:48:31.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35942025-01-13T22:48:31.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35952025-01-13T22:48:31.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35962025-01-13T22:48:31.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35972025-01-13T22:48:31.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35982025-01-13T22:48:31.395ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35992025-01-13T22:48:31.395ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01c110b9-0eba-40f7-ae8b-5697e0aef5a7", "content-length": "26", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
36002025-01-13T22:48:31.395ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36012025-01-13T22:48:31.397ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36022025-01-13T22:48:31.405ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032025-01-13T22:48:31.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36042025-01-13T22:48:31.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36052025-01-13T22:48:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36062025-01-13T22:48:31.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36072025-01-13T22:48:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36082025-01-13T22:48:31.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-01-13T22:48:31.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36102025-01-13T22:48:31.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36112025-01-13T22:48:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36122025-01-13T22:48:31.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36132025-01-13T22:48:31.413ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36142025-01-13T22:48:31.413ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36152025-01-13T22:48:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36162025-01-13T22:48:31.414ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "67828298-fd95-41c9-846a-346c447efc89", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
36172025-01-13T22:48:31.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36182025-01-13T22:48:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36192025-01-13T22:48:31.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36202025-01-13T22:48:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36212025-01-13T22:48:31.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36222025-01-13T22:48:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36232025-01-13T22:48:31.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36242025-01-13T22:48:31.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36252025-01-13T22:48:31.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36262025-01-13T22:48:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36272025-01-13T22:48:31.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36282025-01-13T22:48:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36292025-01-13T22:48:31.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36302025-01-13T22:48:31.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36312025-01-13T22:48:31.422ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36322025-01-13T22:48:31.422ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36332025-01-13T22:48:31.422ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4f787091-3899-4dee-bbe8-7b0d378026f0", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
36342025-01-13T22:48:31.424ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.180766ms iteration = 11 status = {}
36352025-01-13T22:48:31.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36362025-01-13T22:48:31.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36372025-01-13T22:48:31.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36382025-01-13T22:48:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36392025-01-13T22:48:31.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36402025-01-13T22:48:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36412025-01-13T22:48:31.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36422025-01-13T22:48:31.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36432025-01-13T22:48:31.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36442025-01-13T22:48:31.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36452025-01-13T22:48:31.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36462025-01-13T22:48:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36472025-01-13T22:48:31.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36482025-01-13T22:48:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36492025-01-13T22:48:31.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36502025-01-13T22:48:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36512025-01-13T22:48:31.495ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36522025-01-13T22:48:31.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36532025-01-13T22:48:31.497ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.353607ms iteration = 11 status = {}
36542025-01-13T22:48:31.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36552025-01-13T22:48:31.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36562025-01-13T22:48:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36572025-01-13T22:48:31.509ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
36582025-01-13T22:48:31.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36592025-01-13T22:48:31.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36602025-01-13T22:48:31.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36612025-01-13T22:48:31.510ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "21c57839-8dfc-4ec3-b335-d7e9c500fb9f", "date": "Mon, 13 Jan 2025 22:48:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36622025-01-13T22:48:31.510ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36632025-01-13T22:48:31.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642025-01-13T22:48:31.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8fac2d40-e794-47bd-8bfe-7517ca0d6b43", "date": "Mon, 13 Jan 2025 22:48:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36652025-01-13T22:48:31.511ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36662025-01-13T22:48:31.512ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
36672025-01-13T22:48:31.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36682025-01-13T22:48:31.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36692025-01-13T22:48:31.513ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36702025-01-13T22:48:31.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 442.163084ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36712025-01-13T22:48:31.514ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
36722025-01-13T22:48:31.514ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
36732025-01-13T22:48:31.514ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
36742025-01-13T22:48:31.531ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36752025-01-13T22:48:31.531ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b8675d-0345-42a1-9e56-40192845b9f4", "content-length": "1", "date": "Mon, 13 Jan 2025 22:48:30 GMT"} })
36762025-01-13T22:48:31.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36772025-01-13T22:48:31.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36782025-01-13T22:48:31.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36792025-01-13T22:48:31.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5d41f3ba-e734-4d11-b6c5-7f5f0ea8b0ba", "date": "Mon, 13 Jan 2025 22:48:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36802025-01-13T22:48:31.579ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36812025-01-13T22:48:31.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "44a632fc-3001-403c-ab5d-5ce1fe4cf078", "date": "Mon, 13 Jan 2025 22:48:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36822025-01-13T22:48:31.581ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36832025-01-13T22:48:31.582ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dffbf585-d2e7-45ab-8416-48e57e599222", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36842025-01-13T22:48:31.582ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36852025-01-13T22:48:31.583ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
36862025-01-13T22:48:31.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 512.803996ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36872025-01-13T22:48:31.591ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36882025-01-13T22:48:31.591ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ebab65-6f4e-40ce-997c-faae8e65f52b", "content-length": "691", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
36892025-01-13T22:48:31.591ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36902025-01-13T22:48:31.591ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36912025-01-13T22:48:31.591ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36922025-01-13T22:48:31.593ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 522.089877ms iteration = 11 status = {}
36932025-01-13T22:48:31.593ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 522.382947ms iteration = 11 status = null
36942025-01-13T22:48:31.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36952025-01-13T22:48:31.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36962025-01-13T22:48:31.611ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
36972025-01-13T22:48:31.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36982025-01-13T22:48:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36992025-01-13T22:48:31.622ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37002025-01-13T22:48:31.622ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a729f14-5c11-4018-affe-66a42c949e7f", "content-length": "134", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
37012025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37022025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
37032025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37042025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37052025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37062025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37072025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37082025-01-13T22:48:31.622ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37092025-01-13T22:48:31.623ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37102025-01-13T22:48:31.623ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37112025-01-13T22:48:31.623ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
37122025-01-13T22:48:31.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37132025-01-13T22:48:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37142025-01-13T22:48:31.624ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37152025-01-13T22:48:31.624ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1c6101f-1bfb-4532-84f2-fa2ee574dac6", "content-length": "2", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
37162025-01-13T22:48:31.624ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37172025-01-13T22:48:31.625ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d458bcfd-03ea-408a-8ccb-bb22f42ea0f6", "content-length": "51", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
37182025-01-13T22:48:31.625ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
37192025-01-13T22:48:31.625ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37202025-01-13T22:48:31.700ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: bd8d50a3-f530-430e-8ded-11b6657cae3b, time_created: 2025-01-13T22:44:11.739186Z, time_modified: 2025-01-13T22:44:11.739186Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
37212025-01-13T22:48:31.700ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
37222025-01-13T22:48:31.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37232025-01-13T22:48:31.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37242025-01-13T22:48:31.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37252025-01-13T22:48:31.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37262025-01-13T22:48:31.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37272025-01-13T22:48:31.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
37282025-01-13T22:48:31.719ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3a8282b-69d0-4831-9f5e-4fd50aaea491", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
37292025-01-13T22:48:31.719ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
37302025-01-13T22:48:31.719ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37312025-01-13T22:48:31.719ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c765fdd5-f450-47ab-bb34-d6b276673896", "content-length": "682", "date": "Mon, 13 Jan 2025 22:48:31 GMT"} })
37322025-01-13T22:48:31.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37332025-01-13T22:48:31.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37342025-01-13T22:48:31.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37352025-01-13T22:48:31.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37362025-01-13T22:48:31.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37372025-01-13T22:48:31.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37382025-01-13T22:48:31.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37392025-01-13T22:48:31.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37402025-01-13T22:48:31.734ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.218885ms iteration = 11 status = {}
37412025-01-13T22:48:31.739ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37422025-01-13T22:48:31.740ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6c154d97-8c7c-4e3b-b286-f9648fc384b0", "date": "Mon, 13 Jan 2025 22:48:30 GMT"} })
37432025-01-13T22:48:31.742ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
37442025-01-13T22:48:31.742ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 670.697431ms
37452025-01-13T22:48:31.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 670.705111ms iteration = 2 status = {}
37462025-01-13T22:48:31.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e05517ba-3440-4558-bd4a-b82a8b8bc238 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37472025-01-13T22:48:31.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e05517ba-3440-4558-bd4a-b82a8b8bc238 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37482025-01-13T22:48:31.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e05517ba-3440-4558-bd4a-b82a8b8bc238 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37492025-01-13T22:48:32.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 94487876-6626-40f9-b533-65965360c4d3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37502025-01-13T22:48:32.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 94487876-6626-40f9-b533-65965360c4d3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37512025-01-13T22:48:32.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 94487876-6626-40f9-b533-65965360c4d3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37522025-01-13T22:48:32.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 937838a4-72b2-4ff9-8e48-fa84a24cdff1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37532025-01-13T22:48:32.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 937838a4-72b2-4ff9-8e48-fa84a24cdff1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37542025-01-13T22:48:32.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 937838a4-72b2-4ff9-8e48-fa84a24cdff1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37552025-01-13T22:48:33.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 88725fc7-7764-4b10-a2c9-3c8bec7fe682 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
37562025-01-13T22:48:33.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3664c7e5-944f-4392-a5ab-a31e845ff563 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37572025-01-13T22:48:33.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3664c7e5-944f-4392-a5ab-a31e845ff563 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37582025-01-13T22:48:33.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3664c7e5-944f-4392-a5ab-a31e845ff563 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37592025-01-13T22:48:34.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9f1819f-c394-408d-8b78-78ddca58f6fb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37602025-01-13T22:48:34.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9f1819f-c394-408d-8b78-78ddca58f6fb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37612025-01-13T22:48:34.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9f1819f-c394-408d-8b78-78ddca58f6fb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37622025-01-13T22:48:35.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a959ad3-87f3-48b0-8b4a-fa2bd70acaf4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37632025-01-13T22:48:35.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a959ad3-87f3-48b0-8b4a-fa2bd70acaf4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37642025-01-13T22:48:35.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a959ad3-87f3-48b0-8b4a-fa2bd70acaf4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37652025-01-13T22:48:36.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70fa42fb-d9c8-40db-a063-754d58852ca1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37662025-01-13T22:48:36.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70fa42fb-d9c8-40db-a063-754d58852ca1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37672025-01-13T22:48:36.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70fa42fb-d9c8-40db-a063-754d58852ca1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37682025-01-13T22:48:37.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3c50cbe1-c0da-4f5c-8e54-b67f05cf2de6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37692025-01-13T22:48:37.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3c50cbe1-c0da-4f5c-8e54-b67f05cf2de6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37702025-01-13T22:48:37.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3c50cbe1-c0da-4f5c-8e54-b67f05cf2de6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37712025-01-13T22:48:38.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dc7f2c8a-4014-4d33-aad7-f9b72b9ce207 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37722025-01-13T22:48:38.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dc7f2c8a-4014-4d33-aad7-f9b72b9ce207 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37732025-01-13T22:48:38.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dc7f2c8a-4014-4d33-aad7-f9b72b9ce207 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37742025-01-13T22:48:39.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 19d46408-bf59-4bdc-85b3-9d12c235c9b2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37752025-01-13T22:48:39.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 19d46408-bf59-4bdc-85b3-9d12c235c9b2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37762025-01-13T22:48:39.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 19d46408-bf59-4bdc-85b3-9d12c235c9b2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37772025-01-13T22:48:40.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c442a4e3-e023-4be4-ae21-efa8cabe74bb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37782025-01-13T22:48:40.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c442a4e3-e023-4be4-ae21-efa8cabe74bb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37792025-01-13T22:48:40.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c442a4e3-e023-4be4-ae21-efa8cabe74bb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
37802025-01-13T22:48:41.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
37812025-01-13T22:48:41.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
37822025-01-13T22:48:41.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37832025-01-13T22:48:41.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37842025-01-13T22:48:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37852025-01-13T22:48:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862025-01-13T22:48:41.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37872025-01-13T22:48:41.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37882025-01-13T22:48:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37892025-01-13T22:48:41.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.188362ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37902025-01-13T22:48:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37912025-01-13T22:48:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37922025-01-13T22:48:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37932025-01-13T22:48:41.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37942025-01-13T22:48:41.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37952025-01-13T22:48:41.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962025-01-13T22:48:41.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
37972025-01-13T22:48:41.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37982025-01-13T22:48:41.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37992025-01-13T22:48:41.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
38002025-01-13T22:48:41.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.000101ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
38012025-01-13T22:48:41.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3e161092-cab7-42c6-bd44-5e14a39cd0ee roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38022025-01-13T22:48:41.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3e161092-cab7-42c6-bd44-5e14a39cd0ee resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38032025-01-13T22:48:41.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3e161092-cab7-42c6-bd44-5e14a39cd0ee response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38042025-01-13T22:48:42.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 83715694-7bb4-4a19-95d8-695ed06f79ac roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38052025-01-13T22:48:42.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 83715694-7bb4-4a19-95d8-695ed06f79ac resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38062025-01-13T22:48:42.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 83715694-7bb4-4a19-95d8-695ed06f79ac response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38072025-01-13T22:48:43.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 03bed850-c9a9-411c-b490-244d81948635 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
38082025-01-13T22:48:43.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 03bed850-c9a9-411c-b490-244d81948635 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
38092025-01-13T22:48:43.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 03bed850-c9a9-411c-b490-244d81948635 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
38102025-01-13T22:48:43.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 58de7936-7481-48d6-9eb6-26155c92e3d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
38112025-01-13T22:48:43.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 58de7936-7481-48d6-9eb6-26155c92e3d3 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
38122025-01-13T22:48:43.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 58de7936-7481-48d6-9eb6-26155c92e3d3 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
38132025-01-13T22:48:43.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = bcc099d7-b33e-4f8e-874a-95a03adec889 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
38142025-01-13T22:48:44.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84acdcf4-65f5-4637-8181-f50b98c6e23d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38152025-01-13T22:48:44.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84acdcf4-65f5-4637-8181-f50b98c6e23d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38162025-01-13T22:48:44.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84acdcf4-65f5-4637-8181-f50b98c6e23d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38172025-01-13T22:48:45.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 75c6a27b-bc44-4564-85e3-7816a350c8c8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38182025-01-13T22:48:45.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 75c6a27b-bc44-4564-85e3-7816a350c8c8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38192025-01-13T22:48:45.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 75c6a27b-bc44-4564-85e3-7816a350c8c8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38202025-01-13T22:48:46.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12cb4404-4ae6-4a38-baf9-ee5b6694568c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38212025-01-13T22:48:46.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12cb4404-4ae6-4a38-baf9-ee5b6694568c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38222025-01-13T22:48:46.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12cb4404-4ae6-4a38-baf9-ee5b6694568c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38232025-01-13T22:48:47.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3019e6e1-b4fe-4ad1-9b16-ba178101a5ae roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38242025-01-13T22:48:47.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3019e6e1-b4fe-4ad1-9b16-ba178101a5ae resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38252025-01-13T22:48:47.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3019e6e1-b4fe-4ad1-9b16-ba178101a5ae response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38262025-01-13T22:48:48.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04da2294-9557-4f5a-878e-cafe980c2114 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38272025-01-13T22:48:48.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04da2294-9557-4f5a-878e-cafe980c2114 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38282025-01-13T22:48:48.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04da2294-9557-4f5a-878e-cafe980c2114 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38292025-01-13T22:48:49.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 60dce67a-cd04-46ab-bfcf-36cef90198bc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38302025-01-13T22:48:49.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 60dce67a-cd04-46ab-bfcf-36cef90198bc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38312025-01-13T22:48:49.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 60dce67a-cd04-46ab-bfcf-36cef90198bc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38322025-01-13T22:48:50.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41d4d93b-9c3f-4fe8-89f2-f373dd93f58a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38332025-01-13T22:48:50.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41d4d93b-9c3f-4fe8-89f2-f373dd93f58a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38342025-01-13T22:48:50.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41d4d93b-9c3f-4fe8-89f2-f373dd93f58a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38352025-01-13T22:48:51.072ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
38362025-01-13T22:48:51.072ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
38372025-01-13T22:48:51.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38382025-01-13T22:48:51.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38392025-01-13T22:48:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38402025-01-13T22:48:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38412025-01-13T22:48:51.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38422025-01-13T22:48:51.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38432025-01-13T22:48:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38442025-01-13T22:48:51.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.968045ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38452025-01-13T22:48:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38462025-01-13T22:48:51.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38472025-01-13T22:48:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38482025-01-13T22:48:51.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38492025-01-13T22:48:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38502025-01-13T22:48:51.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38512025-01-13T22:48:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
38522025-01-13T22:48:51.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38532025-01-13T22:48:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38542025-01-13T22:48:51.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
38552025-01-13T22:48:51.095ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.657874ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
38562025-01-13T22:48:51.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 48dc25c0-2460-466e-9aa3-0ea74f14357d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38572025-01-13T22:48:51.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 48dc25c0-2460-466e-9aa3-0ea74f14357d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38582025-01-13T22:48:51.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 48dc25c0-2460-466e-9aa3-0ea74f14357d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38592025-01-13T22:48:52.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c829dfdb-48f3-4b7c-9f35-83fc23879d11 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38602025-01-13T22:48:52.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c829dfdb-48f3-4b7c-9f35-83fc23879d11 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38612025-01-13T22:48:52.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c829dfdb-48f3-4b7c-9f35-83fc23879d11 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38622025-01-13T22:48:53.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 406afb89-82db-4449-b933-56a26e2a6d39 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38632025-01-13T22:48:53.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 406afb89-82db-4449-b933-56a26e2a6d39 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38642025-01-13T22:48:53.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 406afb89-82db-4449-b933-56a26e2a6d39 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38652025-01-13T22:48:53.511ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 538 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = a85116a1-46cb-448b-a6b0-ebdbf727a8c1 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
38662025-01-13T22:48:54.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d9c6fc2d-92bf-4604-a252-a0d5ae621950 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38672025-01-13T22:48:54.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d9c6fc2d-92bf-4604-a252-a0d5ae621950 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38682025-01-13T22:48:54.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d9c6fc2d-92bf-4604-a252-a0d5ae621950 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38692025-01-13T22:48:55.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 23af93d1-90bc-4d7e-a0d4-9fced42fd1c2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38702025-01-13T22:48:55.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 23af93d1-90bc-4d7e-a0d4-9fced42fd1c2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38712025-01-13T22:48:55.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 23af93d1-90bc-4d7e-a0d4-9fced42fd1c2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38722025-01-13T22:48:56.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce1b48c9-72df-4990-b87d-5f1fdb8f693a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38732025-01-13T22:48:56.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce1b48c9-72df-4990-b87d-5f1fdb8f693a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38742025-01-13T22:48:56.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce1b48c9-72df-4990-b87d-5f1fdb8f693a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38752025-01-13T22:48:57.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = afdfd495-c979-46f6-bc13-7c91476ab846 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38762025-01-13T22:48:57.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = afdfd495-c979-46f6-bc13-7c91476ab846 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38772025-01-13T22:48:57.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = afdfd495-c979-46f6-bc13-7c91476ab846 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38782025-01-13T22:48:58.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e925605e-91b2-404a-b9d3-5cf42e600820 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38792025-01-13T22:48:58.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e925605e-91b2-404a-b9d3-5cf42e600820 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38802025-01-13T22:48:58.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e925605e-91b2-404a-b9d3-5cf42e600820 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38812025-01-13T22:48:59.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6f01a3cb-209f-4794-a0f0-af6c7ae9bf1b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38822025-01-13T22:48:59.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6f01a3cb-209f-4794-a0f0-af6c7ae9bf1b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38832025-01-13T22:48:59.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6f01a3cb-209f-4794-a0f0-af6c7ae9bf1b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38842025-01-13T22:49:00.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1f145603-a4bd-46a4-91e0-a7be0a599b35 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38852025-01-13T22:49:00.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1f145603-a4bd-46a4-91e0-a7be0a599b35 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38862025-01-13T22:49:00.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1f145603-a4bd-46a4-91e0-a7be0a599b35 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
38872025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
38882025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
38892025-01-13T22:49:01.071ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38902025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38912025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
38922025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38932025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38942025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
38952025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
38962025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38972025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38982025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
38992025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
39002025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
39012025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39022025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39032025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39042025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
39052025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39062025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
39072025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39082025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39092025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
39102025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
39112025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39122025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
39132025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39142025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
39152025-01-13T22:49:01.071ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
39162025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39172025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39182025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
39192025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39202025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
39212025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39222025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
39232025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39242025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39252025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39262025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39272025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39282025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39292025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39302025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39312025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39322025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39332025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39342025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39352025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39362025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39372025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39382025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39392025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39402025-01-13T22:49:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39412025-01-13T22:49:01.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422025-01-13T22:49:01.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39432025-01-13T22:49:01.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39442025-01-13T22:49:01.075ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.766629ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39452025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39462025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39472025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39482025-01-13T22:49:01.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3000, tv_nsec: 701079864 } })
39492025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39502025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39512025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39522025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39532025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39542025-01-13T22:49:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39552025-01-13T22:49:01.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39562025-01-13T22:49:01.078ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39572025-01-13T22:49:01.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582025-01-13T22:49:01.080ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3000, tv_nsec: 704540683 } })
39592025-01-13T22:49:01.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39602025-01-13T22:49:01.080ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39612025-01-13T22:49:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39622025-01-13T22:49:01.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39632025-01-13T22:49:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39642025-01-13T22:49:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39652025-01-13T22:49:01.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39662025-01-13T22:49:01.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672025-01-13T22:49:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39682025-01-13T22:49:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39692025-01-13T22:49:01.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39702025-01-13T22:49:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39712025-01-13T22:49:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39722025-01-13T22:49:01.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39732025-01-13T22:49:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39742025-01-13T22:49:01.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39752025-01-13T22:49:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39762025-01-13T22:49:01.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39772025-01-13T22:49:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39782025-01-13T22:49:01.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39792025-01-13T22:49:01.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3000, tv_nsec: 714030531 } })
39802025-01-13T22:49:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39812025-01-13T22:49:01.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
39822025-01-13T22:49:01.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39832025-01-13T22:49:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39842025-01-13T22:49:01.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.080667ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
39852025-01-13T22:49:01.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39862025-01-13T22:49:01.118ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39872025-01-13T22:49:01.118ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39882025-01-13T22:49:01.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39892025-01-13T22:49:01.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39902025-01-13T22:49:01.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39912025-01-13T22:49:01.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39922025-01-13T22:49:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39932025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39942025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39952025-01-13T22:49:01.120ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39962025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39972025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39982025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39992025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40002025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40012025-01-13T22:49:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40022025-01-13T22:49:01.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40032025-01-13T22:49:01.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40042025-01-13T22:49:01.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40052025-01-13T22:49:01.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.011364ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
40062025-01-13T22:49:01.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.610755ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40072025-01-13T22:49:01.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082025-01-13T22:49:01.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40092025-01-13T22:49:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40102025-01-13T22:49:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40112025-01-13T22:49:01.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40122025-01-13T22:49:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40132025-01-13T22:49:01.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.003487ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40142025-01-13T22:49:01.141ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40152025-01-13T22:49:01.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40162025-01-13T22:49:01.143ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172025-01-13T22:49:01.143ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40182025-01-13T22:49:01.143ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.928732ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40192025-01-13T22:49:01.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40202025-01-13T22:49:01.144ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40212025-01-13T22:49:01.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40222025-01-13T22:49:01.144ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40232025-01-13T22:49:01.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40242025-01-13T22:49:01.144ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b11cc2e-01f0-42e6-a7cf-39755ff464ff", "content-length": "26", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40252025-01-13T22:49:01.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40262025-01-13T22:49:01.146ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40272025-01-13T22:49:01.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
40282025-01-13T22:49:01.147ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40292025-01-13T22:49:01.147ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db1e39a1-819f-49bc-878a-74267681c9ef", "content-length": "26", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40302025-01-13T22:49:01.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40312025-01-13T22:49:01.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322025-01-13T22:49:01.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40332025-01-13T22:49:01.149ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40342025-01-13T22:49:01.150ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a7e723e-3759-4ed6-ad1b-013a2c9f8d75", "content-length": "26", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40352025-01-13T22:49:01.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
40362025-01-13T22:49:01.150ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40372025-01-13T22:49:01.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
40382025-01-13T22:49:01.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40392025-01-13T22:49:01.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40402025-01-13T22:49:01.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40412025-01-13T22:49:01.157ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40422025-01-13T22:49:01.157ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40432025-01-13T22:49:01.157ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.86313ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40442025-01-13T22:49:01.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40452025-01-13T22:49:01.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40462025-01-13T22:49:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
40472025-01-13T22:49:01.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40482025-01-13T22:49:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40492025-01-13T22:49:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40502025-01-13T22:49:01.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.598451ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40512025-01-13T22:49:01.163ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.954991ms iteration = 12 status = 0
40522025-01-13T22:49:01.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.984313ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40532025-01-13T22:49:01.164ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
40542025-01-13T22:49:01.164ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.478618ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
40552025-01-13T22:49:01.182ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
40562025-01-13T22:49:01.182ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 110.891887ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40572025-01-13T22:49:01.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40582025-01-13T22:49:01.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40592025-01-13T22:49:01.228ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 156.361706ms iteration = 12 status = {}
40602025-01-13T22:49:01.228ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.341626ms iteration = 14 status = {"physical_disks_added":0}
40612025-01-13T22:49:01.235ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40622025-01-13T22:49:01.235ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5ac2218-c208-4efa-b386-44c6108ff6b7", "content-length": "1", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40632025-01-13T22:49:01.236ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40642025-01-13T22:49:01.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40652025-01-13T22:49:01.238ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 166.206786ms iteration = 12 status = null
40662025-01-13T22:49:01.270ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40672025-01-13T22:49:01.270ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40682025-01-13T22:49:01.270ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8678b622-3f30-455c-b1ca-bcf23848dcd1", "content-length": "372", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40692025-01-13T22:49:01.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40702025-01-13T22:49:01.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40712025-01-13T22:49:01.284ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40722025-01-13T22:49:01.284ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40732025-01-13T22:49:01.284ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b61bfd7-e7c1-4224-9f8f-0956f195c83b", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40742025-01-13T22:49:01.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40752025-01-13T22:49:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40762025-01-13T22:49:01.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40772025-01-13T22:49:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40782025-01-13T22:49:01.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40792025-01-13T22:49:01.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40802025-01-13T22:49:01.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40812025-01-13T22:49:01.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40822025-01-13T22:49:01.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40832025-01-13T22:49:01.294ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40842025-01-13T22:49:01.294ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40852025-01-13T22:49:01.294ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0cb3e59a-1cf2-4275-a002-55e2ccef71e2", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
40862025-01-13T22:49:01.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40872025-01-13T22:49:01.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40882025-01-13T22:49:01.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40892025-01-13T22:49:01.296ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 224.330894ms iteration = 12 status = {}
40902025-01-13T22:49:01.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912025-01-13T22:49:01.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40922025-01-13T22:49:01.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40932025-01-13T22:49:01.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40942025-01-13T22:49:01.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40952025-01-13T22:49:01.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40962025-01-13T22:49:01.330ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
40972025-01-13T22:49:01.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40982025-01-13T22:49:01.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40992025-01-13T22:49:01.337ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41002025-01-13T22:49:01.337ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6abd3f0c-3121-4485-9ee5-911290d9a03f", "content-length": "134", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
41012025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41022025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
41032025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41042025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41052025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41062025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41072025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41082025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41092025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41102025-01-13T22:49:01.337ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41112025-01-13T22:49:01.338ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
41122025-01-13T22:49:01.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41132025-01-13T22:49:01.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41142025-01-13T22:49:01.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41152025-01-13T22:49:01.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "da67aebe-e7d2-49fb-b89a-5783ef9bee77", "content-length": "2", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
41162025-01-13T22:49:01.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41172025-01-13T22:49:01.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b76fea53-cbaa-4f88-8230-87a55541d781", "content-length": "51", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
41182025-01-13T22:49:01.340ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
41192025-01-13T22:49:01.340ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41202025-01-13T22:49:01.345ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41212025-01-13T22:49:01.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d9fa983-f370-4d5e-b717-b6723935bd29", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
41222025-01-13T22:49:01.436ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
41232025-01-13T22:49:01.437ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41242025-01-13T22:49:01.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bf6424ef-8849-46b3-b5ad-4c5d5a09f3ae roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41252025-01-13T22:49:01.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bf6424ef-8849-46b3-b5ad-4c5d5a09f3ae resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41262025-01-13T22:49:01.437ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8128cdb-2759-401e-82f6-8e94495ba150", "content-length": "682", "date": "Mon, 13 Jan 2025 22:49:01 GMT"} })
41272025-01-13T22:49:01.437ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "12cfd06b-8b81-45ea-9432-f1af936388cb", "content-length": "691", "date": "Mon, 13 Jan 2025 22:49:00 GMT"} })
41282025-01-13T22:49:01.437ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41292025-01-13T22:49:01.437ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41302025-01-13T22:49:01.437ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41312025-01-13T22:49:01.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41322025-01-13T22:49:01.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41332025-01-13T22:49:01.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bf6424ef-8849-46b3-b5ad-4c5d5a09f3ae response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41342025-01-13T22:49:01.439ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 367.921349ms iteration = 12 status = {}
41352025-01-13T22:49:01.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41362025-01-13T22:49:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41372025-01-13T22:49:01.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41382025-01-13T22:49:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41392025-01-13T22:49:01.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41402025-01-13T22:49:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41412025-01-13T22:49:01.451ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 379.597997ms iteration = 12 status = {}
41422025-01-13T22:49:02.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ce3afe40-5d29-497f-bfa3-92a39cf60044 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41432025-01-13T22:49:02.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ce3afe40-5d29-497f-bfa3-92a39cf60044 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41442025-01-13T22:49:02.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ce3afe40-5d29-497f-bfa3-92a39cf60044 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41452025-01-13T22:49:02.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 45afb3b8-9fd1-4ae4-87ee-88a1cfbb66d2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41462025-01-13T22:49:02.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 45afb3b8-9fd1-4ae4-87ee-88a1cfbb66d2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41472025-01-13T22:49:02.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 45afb3b8-9fd1-4ae4-87ee-88a1cfbb66d2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41482025-01-13T22:49:03.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94c6eec7-04ca-48d4-a47e-1e553eea8ee5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41492025-01-13T22:49:03.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94c6eec7-04ca-48d4-a47e-1e553eea8ee5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41502025-01-13T22:49:03.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94c6eec7-04ca-48d4-a47e-1e553eea8ee5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41512025-01-13T22:49:03.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = ba5f7fbc-1607-4f88-8383-438adaf7c838 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
41522025-01-13T22:49:04.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6730d2e5-a070-4795-b076-4d438020312b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41532025-01-13T22:49:04.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6730d2e5-a070-4795-b076-4d438020312b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41542025-01-13T22:49:04.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6730d2e5-a070-4795-b076-4d438020312b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41552025-01-13T22:49:05.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b1180594-bee6-4f83-96a9-fd3ffdb7ccdd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41562025-01-13T22:49:05.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b1180594-bee6-4f83-96a9-fd3ffdb7ccdd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41572025-01-13T22:49:05.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b1180594-bee6-4f83-96a9-fd3ffdb7ccdd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41582025-01-13T22:49:06.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8809c9b-7786-42f7-a0f0-55f45834759d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41592025-01-13T22:49:06.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8809c9b-7786-42f7-a0f0-55f45834759d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41602025-01-13T22:49:06.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8809c9b-7786-42f7-a0f0-55f45834759d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41612025-01-13T22:49:07.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7be63b96-ee56-485c-99c9-adf014d9663b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41622025-01-13T22:49:07.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7be63b96-ee56-485c-99c9-adf014d9663b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41632025-01-13T22:49:07.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7be63b96-ee56-485c-99c9-adf014d9663b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41642025-01-13T22:49:08.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0930876c-b90f-4118-86c5-a35141ce1935 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41652025-01-13T22:49:08.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0930876c-b90f-4118-86c5-a35141ce1935 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41662025-01-13T22:49:08.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0930876c-b90f-4118-86c5-a35141ce1935 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41672025-01-13T22:49:09.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 387be0ec-db21-4b85-a4cd-f27b8e41ac42 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41682025-01-13T22:49:09.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 387be0ec-db21-4b85-a4cd-f27b8e41ac42 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41692025-01-13T22:49:09.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 387be0ec-db21-4b85-a4cd-f27b8e41ac42 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41702025-01-13T22:49:10.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4d2e4363-4814-4147-85ca-ea291f0b7f1d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41712025-01-13T22:49:10.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4d2e4363-4814-4147-85ca-ea291f0b7f1d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41722025-01-13T22:49:10.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4d2e4363-4814-4147-85ca-ea291f0b7f1d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41732025-01-13T22:49:11.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
41742025-01-13T22:49:11.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
41752025-01-13T22:49:11.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41762025-01-13T22:49:11.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41772025-01-13T22:49:11.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41782025-01-13T22:49:11.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41792025-01-13T22:49:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802025-01-13T22:49:11.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41812025-01-13T22:49:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41822025-01-13T22:49:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41832025-01-13T22:49:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41842025-01-13T22:49:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41852025-01-13T22:49:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41862025-01-13T22:49:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41872025-01-13T22:49:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882025-01-13T22:49:11.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
41892025-01-13T22:49:11.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41902025-01-13T22:49:11.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41912025-01-13T22:49:11.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
41922025-01-13T22:49:11.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.107055ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
41932025-01-13T22:49:11.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.671463ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41942025-01-13T22:49:11.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 82af281f-7a87-496d-bfbc-16d6e4e109c0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41952025-01-13T22:49:11.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 82af281f-7a87-496d-bfbc-16d6e4e109c0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41962025-01-13T22:49:11.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 82af281f-7a87-496d-bfbc-16d6e4e109c0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41972025-01-13T22:49:12.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb4b8d17-1744-434e-a11d-edff69241dce roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41982025-01-13T22:49:12.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb4b8d17-1744-434e-a11d-edff69241dce resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
41992025-01-13T22:49:12.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb4b8d17-1744-434e-a11d-edff69241dce response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42002025-01-13T22:49:13.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 8f3dbb7f-591a-401e-b7db-3a71ed55b0d9 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
42012025-01-13T22:49:13.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 8f3dbb7f-591a-401e-b7db-3a71ed55b0d9 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
42022025-01-13T22:49:13.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 8f3dbb7f-591a-401e-b7db-3a71ed55b0d9 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
42032025-01-13T22:49:13.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 6e640c08-2233-4f34-b68c-694395737459 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
42042025-01-13T22:49:13.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 6e640c08-2233-4f34-b68c-694395737459 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
42052025-01-13T22:49:13.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 6e640c08-2233-4f34-b68c-694395737459 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
42062025-01-13T22:49:13.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 906c9d82-1f8d-4ea2-815a-f074eb32559c response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
42072025-01-13T22:49:13.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 62e68a1b-ab68-40e5-8d03-9528bab11db6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42082025-01-13T22:49:13.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 62e68a1b-ab68-40e5-8d03-9528bab11db6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42092025-01-13T22:49:13.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 62e68a1b-ab68-40e5-8d03-9528bab11db6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42102025-01-13T22:49:14.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = db446d02-d6ee-41d5-98b8-4da9fbf03660 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42112025-01-13T22:49:14.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = db446d02-d6ee-41d5-98b8-4da9fbf03660 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42122025-01-13T22:49:14.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = db446d02-d6ee-41d5-98b8-4da9fbf03660 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42132025-01-13T22:49:15.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 80a8e571-9090-4a61-9074-065d805ae799 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42142025-01-13T22:49:15.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 80a8e571-9090-4a61-9074-065d805ae799 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42152025-01-13T22:49:15.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 80a8e571-9090-4a61-9074-065d805ae799 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42162025-01-13T22:49:16.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 463d167d-4d06-4c5a-8533-a9c7d4cc9379 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42172025-01-13T22:49:16.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 463d167d-4d06-4c5a-8533-a9c7d4cc9379 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42182025-01-13T22:49:16.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 463d167d-4d06-4c5a-8533-a9c7d4cc9379 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42192025-01-13T22:49:17.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d54f94e2-44ca-436e-8f80-567cd1341e98 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42202025-01-13T22:49:17.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d54f94e2-44ca-436e-8f80-567cd1341e98 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42212025-01-13T22:49:17.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d54f94e2-44ca-436e-8f80-567cd1341e98 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42222025-01-13T22:49:18.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21e4d267-0df4-4864-9326-b9b2af5adf1d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42232025-01-13T22:49:18.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21e4d267-0df4-4864-9326-b9b2af5adf1d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42242025-01-13T22:49:18.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21e4d267-0df4-4864-9326-b9b2af5adf1d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42252025-01-13T22:49:19.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b99cde29-b7e3-423d-92ae-6b2a7bb56a2c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42262025-01-13T22:49:19.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b99cde29-b7e3-423d-92ae-6b2a7bb56a2c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42272025-01-13T22:49:19.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b99cde29-b7e3-423d-92ae-6b2a7bb56a2c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42282025-01-13T22:49:20.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c6e5e64e-8d9d-44e1-ab7d-46c52594fac1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42292025-01-13T22:49:20.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c6e5e64e-8d9d-44e1-ab7d-46c52594fac1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42302025-01-13T22:49:20.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c6e5e64e-8d9d-44e1-ab7d-46c52594fac1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42312025-01-13T22:49:21.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
42322025-01-13T22:49:21.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
42332025-01-13T22:49:21.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42342025-01-13T22:49:21.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42352025-01-13T22:49:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42362025-01-13T22:49:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42372025-01-13T22:49:21.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42382025-01-13T22:49:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42392025-01-13T22:49:21.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402025-01-13T22:49:21.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.496542ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42412025-01-13T22:49:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42422025-01-13T22:49:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42432025-01-13T22:49:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42442025-01-13T22:49:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42452025-01-13T22:49:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42462025-01-13T22:49:21.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472025-01-13T22:49:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
42482025-01-13T22:49:21.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42492025-01-13T22:49:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42502025-01-13T22:49:21.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
42512025-01-13T22:49:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.863483ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
42522025-01-13T22:49:21.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 393fb763-427c-4ad4-b9d1-b4c6304a6087 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42532025-01-13T22:49:21.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 393fb763-427c-4ad4-b9d1-b4c6304a6087 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42542025-01-13T22:49:21.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 393fb763-427c-4ad4-b9d1-b4c6304a6087 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42552025-01-13T22:49:22.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c19dd864-4b89-4919-9b1c-ca26f07ad328 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42562025-01-13T22:49:22.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c19dd864-4b89-4919-9b1c-ca26f07ad328 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42572025-01-13T22:49:22.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c19dd864-4b89-4919-9b1c-ca26f07ad328 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42582025-01-13T22:49:23.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 545 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 5d724f5b-b5b1-450d-8560-8271361dbf0a response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
42592025-01-13T22:49:23.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2c23d94c-aad8-4a2a-99a5-3246e88623ac roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42602025-01-13T22:49:23.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2c23d94c-aad8-4a2a-99a5-3246e88623ac resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42612025-01-13T22:49:23.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2c23d94c-aad8-4a2a-99a5-3246e88623ac response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42622025-01-13T22:49:24.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a582c0c0-9fb2-479f-997b-859b351eb2cd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42632025-01-13T22:49:24.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a582c0c0-9fb2-479f-997b-859b351eb2cd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42642025-01-13T22:49:24.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a582c0c0-9fb2-479f-997b-859b351eb2cd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42652025-01-13T22:49:25.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 10df379d-5dcb-42db-9f5f-baca6a65f9f8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42662025-01-13T22:49:25.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 10df379d-5dcb-42db-9f5f-baca6a65f9f8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42672025-01-13T22:49:25.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 10df379d-5dcb-42db-9f5f-baca6a65f9f8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42682025-01-13T22:49:26.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68320823-dd1c-4f8e-9731-b074c821c3ba roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42692025-01-13T22:49:26.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68320823-dd1c-4f8e-9731-b074c821c3ba resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42702025-01-13T22:49:26.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68320823-dd1c-4f8e-9731-b074c821c3ba response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42712025-01-13T22:49:27.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a98caa7d-835a-43ec-b1cb-34651cd99e11 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42722025-01-13T22:49:27.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a98caa7d-835a-43ec-b1cb-34651cd99e11 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42732025-01-13T22:49:27.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a98caa7d-835a-43ec-b1cb-34651cd99e11 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42742025-01-13T22:49:29.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec1c3fff-ccaf-4f0e-a55a-1e5cd3782cf8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42752025-01-13T22:49:29.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec1c3fff-ccaf-4f0e-a55a-1e5cd3782cf8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42762025-01-13T22:49:29.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec1c3fff-ccaf-4f0e-a55a-1e5cd3782cf8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42772025-01-13T22:49:30.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d6029119-1922-4726-be47-b0f0e3e1a136 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42782025-01-13T22:49:30.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d6029119-1922-4726-be47-b0f0e3e1a136 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42792025-01-13T22:49:30.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d6029119-1922-4726-be47-b0f0e3e1a136 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42802025-01-13T22:49:31.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9251dd58-abfc-4009-a7a6-48ddce74a18a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42812025-01-13T22:49:31.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9251dd58-abfc-4009-a7a6-48ddce74a18a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42822025-01-13T22:49:31.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9251dd58-abfc-4009-a7a6-48ddce74a18a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
42832025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
42842025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
42852025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
42862025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42872025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42882025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
42892025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
42902025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
42912025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42922025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
42932025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42942025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42952025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42962025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42972025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42982025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
42992025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
43002025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43012025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43022025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
43032025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
43042025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43052025-01-13T22:49:31.070ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43062025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43072025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
43082025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43092025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
43102025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43112025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43122025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
43132025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43142025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
43152025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43162025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
43172025-01-13T22:49:31.070ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
43182025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43192025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
43202025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43212025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
43222025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
43232025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43242025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43252025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
43262025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43272025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
43282025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43292025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
43302025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43312025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
43322025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
43332025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43342025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43352025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
43362025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43372025-01-13T22:49:31.071ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43382025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
43392025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
43402025-01-13T22:49:31.071ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
43412025-01-13T22:49:31.071ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:39:31.070965871 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43422025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43432025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.321\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
43442025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43452025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
43462025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
43472025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43482025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43492025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
43502025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43512025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
43522025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43532025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43542025-01-13T22:49:31.071ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3030, tv_nsec: 695851900 } })
43552025-01-13T22:49:31.071ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3030, tv_nsec: 695911741 } })
43562025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43572025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43582025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43592025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43602025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43612025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43622025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43632025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43642025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43652025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43662025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43672025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43682025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43692025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43702025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43712025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43722025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43732025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43742025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43752025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43762025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43772025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43782025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43792025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43802025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43812025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.539129ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43822025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43832025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43842025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43852025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.617411ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43862025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43872025-01-13T22:49:31.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43882025-01-13T22:49:31.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43892025-01-13T22:49:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43902025-01-13T22:49:31.072ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43912025-01-13T22:49:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43922025-01-13T22:49:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43932025-01-13T22:49:31.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43942025-01-13T22:49:31.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952025-01-13T22:49:31.076ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43962025-01-13T22:49:31.076ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.855594ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43972025-01-13T22:49:31.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43982025-01-13T22:49:31.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43992025-01-13T22:49:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44002025-01-13T22:49:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44012025-01-13T22:49:31.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44022025-01-13T22:49:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44032025-01-13T22:49:31.078ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042025-01-13T22:49:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44052025-01-13T22:49:31.079ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44062025-01-13T22:49:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44072025-01-13T22:49:31.080ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44082025-01-13T22:49:31.080ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44092025-01-13T22:49:31.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44102025-01-13T22:49:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44112025-01-13T22:49:31.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44122025-01-13T22:49:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44132025-01-13T22:49:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44142025-01-13T22:49:31.082ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44152025-01-13T22:49:31.082ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.373258ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
44162025-01-13T22:49:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44172025-01-13T22:49:31.083ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:39:31.070965871 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44182025-01-13T22:49:31.083ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.468192ms iteration = 7 status = {"expiration":"2025-01-13T22:39:31.070965871Z","pruned":[]}
44192025-01-13T22:49:31.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44202025-01-13T22:49:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44212025-01-13T22:49:31.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44222025-01-13T22:49:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44232025-01-13T22:49:31.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242025-01-13T22:49:31.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3030, tv_nsec: 713862146 } })
44252025-01-13T22:49:31.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44262025-01-13T22:49:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44272025-01-13T22:49:31.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44282025-01-13T22:49:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44292025-01-13T22:49:31.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3030, tv_nsec: 716466568 } })
44302025-01-13T22:49:31.092ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
44312025-01-13T22:49:31.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = cd58f7ec-69f7-4efc-8a8e-2b50fea04386 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
44322025-01-13T22:49:31.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = cd58f7ec-69f7-4efc-8a8e-2b50fea04386 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
44332025-01-13T22:49:31.093ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342025-01-13T22:49:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44352025-01-13T22:49:31.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44362025-01-13T22:49:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44372025-01-13T22:49:31.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382025-01-13T22:49:31.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44392025-01-13T22:49:31.097ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44402025-01-13T22:49:31.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44412025-01-13T22:49:31.098ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44422025-01-13T22:49:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44432025-01-13T22:49:31.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44442025-01-13T22:49:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44452025-01-13T22:49:31.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44462025-01-13T22:49:31.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44472025-01-13T22:49:31.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44482025-01-13T22:49:31.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44492025-01-13T22:49:31.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44502025-01-13T22:49:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44512025-01-13T22:49:31.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44522025-01-13T22:49:31.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44532025-01-13T22:49:31.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.875688ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
44542025-01-13T22:49:31.127ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44552025-01-13T22:49:31.127ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44562025-01-13T22:49:31.127ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.030693ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44572025-01-13T22:49:31.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44582025-01-13T22:49:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44592025-01-13T22:49:31.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44602025-01-13T22:49:31.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.081654ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
44612025-01-13T22:49:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44622025-01-13T22:49:31.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44632025-01-13T22:49:31.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44642025-01-13T22:49:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44652025-01-13T22:49:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44662025-01-13T22:49:31.136ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672025-01-13T22:49:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44682025-01-13T22:49:31.137ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44692025-01-13T22:49:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44702025-01-13T22:49:31.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = cd58f7ec-69f7-4efc-8a8e-2b50fea04386 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
44712025-01-13T22:49:31.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44722025-01-13T22:49:31.140ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44732025-01-13T22:49:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44742025-01-13T22:49:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44752025-01-13T22:49:31.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44762025-01-13T22:49:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44772025-01-13T22:49:31.143ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 72.83503ms iteration = 4 status = {"nsuccess":5}
44782025-01-13T22:49:31.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44792025-01-13T22:49:31.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802025-01-13T22:49:31.145ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3030, tv_nsec: 770455986 } })
44812025-01-13T22:49:31.146ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
44822025-01-13T22:49:31.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44832025-01-13T22:49:31.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44842025-01-13T22:49:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44852025-01-13T22:49:31.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44862025-01-13T22:49:31.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44872025-01-13T22:49:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44882025-01-13T22:49:31.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44892025-01-13T22:49:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44902025-01-13T22:49:31.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44912025-01-13T22:49:31.151ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44922025-01-13T22:49:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44932025-01-13T22:49:31.152ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44942025-01-13T22:49:31.152ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44952025-01-13T22:49:31.152ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44962025-01-13T22:49:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44972025-01-13T22:49:31.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44982025-01-13T22:49:31.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44992025-01-13T22:49:31.153ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45002025-01-13T22:49:31.153ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45012025-01-13T22:49:31.153ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.850356ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45022025-01-13T22:49:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45032025-01-13T22:49:31.154ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45042025-01-13T22:49:31.155ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45052025-01-13T22:49:31.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.735864ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45062025-01-13T22:49:31.155ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45072025-01-13T22:49:31.155ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45082025-01-13T22:49:31.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.090886ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45092025-01-13T22:49:31.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45102025-01-13T22:49:31.157ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45112025-01-13T22:49:31.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45122025-01-13T22:49:31.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45132025-01-13T22:49:31.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45142025-01-13T22:49:31.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45152025-01-13T22:49:31.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45162025-01-13T22:49:31.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45172025-01-13T22:49:31.182ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45182025-01-13T22:49:31.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45192025-01-13T22:49:31.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.788887ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45202025-01-13T22:49:31.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45212025-01-13T22:49:31.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45222025-01-13T22:49:31.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45232025-01-13T22:49:31.188ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45242025-01-13T22:49:31.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45252025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45262025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45272025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45282025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45292025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45302025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45312025-01-13T22:49:31.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322025-01-13T22:49:31.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.763399ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45332025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
45342025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45362025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45372025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45382025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45392025-01-13T22:49:31.194ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45402025-01-13T22:49:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45412025-01-13T22:49:31.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.282729ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45422025-01-13T22:49:31.203ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.855518ms iteration = 15 status = {"physical_disks_added":0}
45432025-01-13T22:49:31.209ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45442025-01-13T22:49:31.209ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45452025-01-13T22:49:31.209ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45462025-01-13T22:49:31.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45472025-01-13T22:49:31.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45482025-01-13T22:49:31.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45492025-01-13T22:49:31.234ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45502025-01-13T22:49:31.235ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aec1261-6318-42dc-b34d-48aaf876e0ef", "content-length": "26", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
45512025-01-13T22:49:31.235ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45522025-01-13T22:49:31.236ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45532025-01-13T22:49:31.260ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45542025-01-13T22:49:31.260ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45552025-01-13T22:49:31.260ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36871b58-7e53-4fb3-854a-ddff2db024e1", "content-length": "26", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
45562025-01-13T22:49:31.260ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45572025-01-13T22:49:31.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45582025-01-13T22:49:31.262ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45592025-01-13T22:49:31.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45602025-01-13T22:49:31.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
45612025-01-13T22:49:31.309ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45622025-01-13T22:49:31.309ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e160379-ee00-4469-988c-7e642a064181", "content-length": "26", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
45632025-01-13T22:49:31.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45642025-01-13T22:49:31.310ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
45652025-01-13T22:49:31.355ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45662025-01-13T22:49:31.410ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45672025-01-13T22:49:31.410ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "48d874cf-9ef0-4395-be2b-83ba097b010d", "content-length": "1", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
45682025-01-13T22:49:31.411ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45692025-01-13T22:49:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45702025-01-13T22:49:31.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45712025-01-13T22:49:31.517ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "97f0d433-09bd-4f85-9a7f-f64dd5810296", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45722025-01-13T22:49:31.517ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45732025-01-13T22:49:31.519ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "290c058d-67f1-4ddf-8eaf-ecf80d6002a2", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45742025-01-13T22:49:31.519ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45752025-01-13T22:49:31.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ef250193-ab9c-428a-84ef-ab317fbec708", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45762025-01-13T22:49:31.520ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45772025-01-13T22:49:31.521ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45782025-01-13T22:49:31.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 451.352433ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45792025-01-13T22:49:31.533ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45802025-01-13T22:49:31.533ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45812025-01-13T22:49:31.533ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "50999b4b-6b81-4b0c-9605-79b415009e7f", "content-length": "372", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
45822025-01-13T22:49:31.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45832025-01-13T22:49:31.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45842025-01-13T22:49:31.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45852025-01-13T22:49:31.535ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45862025-01-13T22:49:31.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45872025-01-13T22:49:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
45882025-01-13T22:49:31.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45892025-01-13T22:49:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45902025-01-13T22:49:31.538ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45912025-01-13T22:49:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45922025-01-13T22:49:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45932025-01-13T22:49:31.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45942025-01-13T22:49:31.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45952025-01-13T22:49:31.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45962025-01-13T22:49:31.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972025-01-13T22:49:31.542ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 471.142845ms iteration = 13 status = null
45982025-01-13T22:49:31.543ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 472.428985ms iteration = 13 status = 0
45992025-01-13T22:49:31.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46002025-01-13T22:49:31.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46012025-01-13T22:49:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46022025-01-13T22:49:31.546ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46032025-01-13T22:49:31.546ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "59a9c921-5629-40ea-bd70-fbb009e08604", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46042025-01-13T22:49:31.547ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46052025-01-13T22:49:31.549ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f3f74a4c-cd22-43b2-a454-ae22d6e9ab05", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46062025-01-13T22:49:31.549ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46072025-01-13T22:49:31.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
46082025-01-13T22:49:31.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 479.275871ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
46092025-01-13T22:49:31.550ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46102025-01-13T22:49:31.550ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 480.795159ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46112025-01-13T22:49:31.566ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 495.109489ms iteration = 13 status = {}
46122025-01-13T22:49:31.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46132025-01-13T22:49:31.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46142025-01-13T22:49:31.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46152025-01-13T22:49:31.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46162025-01-13T22:49:31.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 500.952813ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46172025-01-13T22:49:31.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46182025-01-13T22:49:31.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46192025-01-13T22:49:31.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46202025-01-13T22:49:31.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46212025-01-13T22:49:31.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46222025-01-13T22:49:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46232025-01-13T22:49:31.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46242025-01-13T22:49:31.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46252025-01-13T22:49:31.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46262025-01-13T22:49:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46272025-01-13T22:49:31.579ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
46282025-01-13T22:49:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 508.072226ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46292025-01-13T22:49:31.579ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46302025-01-13T22:49:31.579ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
46312025-01-13T22:49:31.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46322025-01-13T22:49:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46332025-01-13T22:49:31.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342025-01-13T22:49:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46352025-01-13T22:49:31.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46362025-01-13T22:49:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46372025-01-13T22:49:31.586ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
46382025-01-13T22:49:31.586ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46392025-01-13T22:49:31.586ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
46402025-01-13T22:49:31.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 516.087109ms iteration = 7 status = {"generation":2}
46412025-01-13T22:49:31.592ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46422025-01-13T22:49:31.592ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46432025-01-13T22:49:31.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46442025-01-13T22:49:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46452025-01-13T22:49:31.601ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46462025-01-13T22:49:31.601ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46472025-01-13T22:49:31.602ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "185e5506-c784-4c9b-8f34-5b7de0f4a69e", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
46482025-01-13T22:49:31.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46492025-01-13T22:49:31.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46502025-01-13T22:49:31.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46512025-01-13T22:49:31.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46522025-01-13T22:49:31.605ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
46532025-01-13T22:49:31.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 534.800207ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46542025-01-13T22:49:31.606ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
46552025-01-13T22:49:31.606ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 536.689266ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46562025-01-13T22:49:31.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46572025-01-13T22:49:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46582025-01-13T22:49:31.611ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46592025-01-13T22:49:31.611ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46602025-01-13T22:49:31.612ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "175ed2c5-59d5-4f9c-a8cd-e03d453b0ffc", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
46612025-01-13T22:49:31.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46622025-01-13T22:49:31.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46632025-01-13T22:49:31.613ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 542.590872ms iteration = 13 status = {}
46642025-01-13T22:49:31.615ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
46652025-01-13T22:49:31.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46662025-01-13T22:49:31.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46672025-01-13T22:49:31.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46682025-01-13T22:49:31.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46692025-01-13T22:49:31.623ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50381a1-4917-4308-958f-3f28dbd55ae3", "content-length": "134", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
46702025-01-13T22:49:31.623ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46712025-01-13T22:49:31.623ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
46722025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46732025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46742025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46752025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46762025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46772025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46782025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46792025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46802025-01-13T22:49:31.624ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
46812025-01-13T22:49:31.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46822025-01-13T22:49:31.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46832025-01-13T22:49:31.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46842025-01-13T22:49:31.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46852025-01-13T22:49:31.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46862025-01-13T22:49:31.627ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46872025-01-13T22:49:31.627ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "911fcdff-0149-4127-95b7-9d16bdc3964b", "content-length": "2", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
46882025-01-13T22:49:31.627ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46892025-01-13T22:49:31.627ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef312e43-fed9-4a78-89b1-51937c032870", "content-length": "51", "date": "Mon, 13 Jan 2025 22:49:30 GMT"} })
46902025-01-13T22:49:31.627ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
46912025-01-13T22:49:31.627ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46922025-01-13T22:49:31.628ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
46932025-01-13T22:49:31.628ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46942025-01-13T22:49:31.628ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
46952025-01-13T22:49:31.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 557.931435ms iteration = 7 status = {"generation":1}
46962025-01-13T22:49:31.668ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46972025-01-13T22:49:31.687ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46982025-01-13T22:49:31.687ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
46992025-01-13T22:49:31.718ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
47002025-01-13T22:49:31.719ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:48910
47012025-01-13T22:49:31.719ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2c146a5-9b1f-4191-bc31-639fe9281518", "content-length": "691", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
47022025-01-13T22:49:31.719ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "46b34bdb-9672-48c1-b945-5cdb764d11ee", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
47032025-01-13T22:49:31.719ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
47042025-01-13T22:49:31.719ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47052025-01-13T22:49:31.719ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
47062025-01-13T22:49:31.719ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
47072025-01-13T22:49:31.719ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
47082025-01-13T22:49:31.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48910 req_id = b89cf1e9-88f8-40b4-8cda-0778bea5a7e2 roles = RoleSet { roles: {} } uri = /metrics/producers
47092025-01-13T22:49:31.719ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea5d3b09-3495-4e38-b900-92e726970784", "content-length": "682", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
47102025-01-13T22:49:31.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47112025-01-13T22:49:31.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48910 req_id = b89cf1e9-88f8-40b4-8cda-0778bea5a7e2 resource = Database result = Ok(()) uri = /metrics/producers
47122025-01-13T22:49:31.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47132025-01-13T22:49:31.721ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 650.186795ms iteration = 13 status = {}
47142025-01-13T22:49:31.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47152025-01-13T22:49:31.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47162025-01-13T22:49:31.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47172025-01-13T22:49:31.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47182025-01-13T22:49:31.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47192025-01-13T22:49:31.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47202025-01-13T22:49:31.736ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 665.445456ms iteration = 13 status = {}
47212025-01-13T22:49:31.754ZINFOnexus: assigned collector to new producer collector_id = 6a8a13ba-b82f-41ac-997c-fb535838d6a4 file = nexus/src/app/oximeter.rs:76 producer_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
47222025-01-13T22:49:31.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35784 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48910 req_id = b89cf1e9-88f8-40b4-8cda-0778bea5a7e2 response_code = 201 uri = /metrics/producers
47232025-01-13T22:49:31.754ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b89cf1e9-88f8-40b4-8cda-0778bea5a7e2", "content-length": "41", "date": "Mon, 13 Jan 2025 22:49:31 GMT"} })
47242025-01-13T22:49:31.756ZDEBGnexus (producer-registration-task): registered with nexus successfully
47252025-01-13T22:49:31.756ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47262025-01-13T22:49:32.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0b259afc-e6c9-40b5-bb1a-938aeae2b76a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47272025-01-13T22:49:32.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0b259afc-e6c9-40b5-bb1a-938aeae2b76a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47282025-01-13T22:49:32.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0b259afc-e6c9-40b5-bb1a-938aeae2b76a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47292025-01-13T22:49:33.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a6c74f03-4c85-4b8c-ab9b-9c0097786d19 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47302025-01-13T22:49:33.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a6c74f03-4c85-4b8c-ab9b-9c0097786d19 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47312025-01-13T22:49:33.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a6c74f03-4c85-4b8c-ab9b-9c0097786d19 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47322025-01-13T22:49:33.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 8ee234e4-56f1-46c2-a9f7-73145f95412d response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
47332025-01-13T22:49:34.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b474278-3d34-49ae-a724-4bda95a7b193 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47342025-01-13T22:49:34.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b474278-3d34-49ae-a724-4bda95a7b193 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47352025-01-13T22:49:34.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b474278-3d34-49ae-a724-4bda95a7b193 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47362025-01-13T22:49:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d13d9f9f-522c-4a05-bdc9-4a065e953b63 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47372025-01-13T22:49:35.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d13d9f9f-522c-4a05-bdc9-4a065e953b63 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47382025-01-13T22:49:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d13d9f9f-522c-4a05-bdc9-4a065e953b63 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47392025-01-13T22:49:36.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59b1c36e-f44f-46d0-8f3f-27f936abf2c6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47402025-01-13T22:49:36.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59b1c36e-f44f-46d0-8f3f-27f936abf2c6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47412025-01-13T22:49:36.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 59b1c36e-f44f-46d0-8f3f-27f936abf2c6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47422025-01-13T22:49:37.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67864d7c-6766-4ea7-bd53-4b1d5e4474d1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47432025-01-13T22:49:37.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67864d7c-6766-4ea7-bd53-4b1d5e4474d1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47442025-01-13T22:49:37.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67864d7c-6766-4ea7-bd53-4b1d5e4474d1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47452025-01-13T22:49:38.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f68f6f0a-286f-4df9-b553-5603d2e2b46a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47462025-01-13T22:49:38.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f68f6f0a-286f-4df9-b553-5603d2e2b46a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47472025-01-13T22:49:38.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f68f6f0a-286f-4df9-b553-5603d2e2b46a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47482025-01-13T22:49:39.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c85a6246-75d4-4346-8616-3c04772dcfe6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47492025-01-13T22:49:39.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c85a6246-75d4-4346-8616-3c04772dcfe6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47502025-01-13T22:49:39.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c85a6246-75d4-4346-8616-3c04772dcfe6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47512025-01-13T22:49:40.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2445e279-42ad-4b6b-ba2b-21c4adf19211 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47522025-01-13T22:49:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2445e279-42ad-4b6b-ba2b-21c4adf19211 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47532025-01-13T22:49:40.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2445e279-42ad-4b6b-ba2b-21c4adf19211 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47542025-01-13T22:49:41.071ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
47552025-01-13T22:49:41.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
47562025-01-13T22:49:41.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47572025-01-13T22:49:41.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47582025-01-13T22:49:41.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47592025-01-13T22:49:41.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47602025-01-13T22:49:41.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47612025-01-13T22:49:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47622025-01-13T22:49:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47632025-01-13T22:49:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47642025-01-13T22:49:41.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47652025-01-13T22:49:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47662025-01-13T22:49:41.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47672025-01-13T22:49:41.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
47682025-01-13T22:49:41.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47692025-01-13T22:49:41.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47702025-01-13T22:49:41.094ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
47712025-01-13T22:49:41.094ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.599562ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
47722025-01-13T22:49:41.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47732025-01-13T22:49:41.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47742025-01-13T22:49:41.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.690603ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47752025-01-13T22:49:41.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 01f64258-6241-4a30-991a-9b4e16866998 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47762025-01-13T22:49:41.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 01f64258-6241-4a30-991a-9b4e16866998 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47772025-01-13T22:49:41.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 01f64258-6241-4a30-991a-9b4e16866998 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47782025-01-13T22:49:42.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e5baebe5-f09b-4479-9d24-e5ec991aaeb5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47792025-01-13T22:49:42.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e5baebe5-f09b-4479-9d24-e5ec991aaeb5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47802025-01-13T22:49:42.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e5baebe5-f09b-4479-9d24-e5ec991aaeb5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47812025-01-13T22:49:43.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 120bade9-8bbd-4471-94fe-c440c7e4739f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47822025-01-13T22:49:43.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 120bade9-8bbd-4471-94fe-c440c7e4739f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47832025-01-13T22:49:43.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 120bade9-8bbd-4471-94fe-c440c7e4739f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47842025-01-13T22:49:43.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 12c14342-9798-40dc-895b-d7fe4828a6aa roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
47852025-01-13T22:49:43.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 12c14342-9798-40dc-895b-d7fe4828a6aa resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
47862025-01-13T22:49:43.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 12c14342-9798-40dc-895b-d7fe4828a6aa response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
47872025-01-13T22:49:43.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = f8176a94-66ec-415a-855a-d5547084a62d roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
47882025-01-13T22:49:43.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = f8176a94-66ec-415a-855a-d5547084a62d resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
47892025-01-13T22:49:43.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = f8176a94-66ec-415a-855a-d5547084a62d response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
47902025-01-13T22:49:43.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 592 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 347b435e-f7e4-4110-8c30-d542a6591eeb response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
47912025-01-13T22:49:44.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 64227d25-c193-4b58-9d32-55bd371cf883 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47922025-01-13T22:49:44.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 64227d25-c193-4b58-9d32-55bd371cf883 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47932025-01-13T22:49:44.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 64227d25-c193-4b58-9d32-55bd371cf883 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47942025-01-13T22:49:45.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5e0414f3-00d4-481e-9de8-f93f1965f0a6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47952025-01-13T22:49:45.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5e0414f3-00d4-481e-9de8-f93f1965f0a6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47962025-01-13T22:49:45.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5e0414f3-00d4-481e-9de8-f93f1965f0a6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47972025-01-13T22:49:46.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 57f9f2f2-29f8-4f2b-97d3-429156ad1fd6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47982025-01-13T22:49:46.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 57f9f2f2-29f8-4f2b-97d3-429156ad1fd6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
47992025-01-13T22:49:46.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 57f9f2f2-29f8-4f2b-97d3-429156ad1fd6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48002025-01-13T22:49:47.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d80c3fa2-6721-4993-83ab-252cc5b03e13 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48012025-01-13T22:49:47.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d80c3fa2-6721-4993-83ab-252cc5b03e13 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48022025-01-13T22:49:47.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d80c3fa2-6721-4993-83ab-252cc5b03e13 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48032025-01-13T22:49:48.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1c84ce75-3cc5-4f1d-8e0a-d9074cc43338 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48042025-01-13T22:49:48.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1c84ce75-3cc5-4f1d-8e0a-d9074cc43338 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48052025-01-13T22:49:48.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1c84ce75-3cc5-4f1d-8e0a-d9074cc43338 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48062025-01-13T22:49:49.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 27bf056b-cc8d-4739-9440-5c734e44f6f9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48072025-01-13T22:49:49.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 27bf056b-cc8d-4739-9440-5c734e44f6f9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48082025-01-13T22:49:49.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 27bf056b-cc8d-4739-9440-5c734e44f6f9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48092025-01-13T22:49:50.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bc7d1205-0f85-4ece-abaa-0e3889e74111 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48102025-01-13T22:49:50.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bc7d1205-0f85-4ece-abaa-0e3889e74111 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48112025-01-13T22:49:50.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bc7d1205-0f85-4ece-abaa-0e3889e74111 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48122025-01-13T22:49:51.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
48132025-01-13T22:49:51.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48142025-01-13T22:49:51.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
48152025-01-13T22:49:51.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48162025-01-13T22:49:51.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48172025-01-13T22:49:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48182025-01-13T22:49:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48192025-01-13T22:49:51.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48202025-01-13T22:49:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48212025-01-13T22:49:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48222025-01-13T22:49:51.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48232025-01-13T22:49:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48242025-01-13T22:49:51.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48252025-01-13T22:49:51.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
48262025-01-13T22:49:51.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48272025-01-13T22:49:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48282025-01-13T22:49:51.096ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
48292025-01-13T22:49:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.732979ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
48302025-01-13T22:49:51.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48312025-01-13T22:49:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48322025-01-13T22:49:51.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.923659ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48332025-01-13T22:49:51.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68ad60cb-88f9-4ffe-a010-6ff72f39235a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48342025-01-13T22:49:51.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68ad60cb-88f9-4ffe-a010-6ff72f39235a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48352025-01-13T22:49:51.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 68ad60cb-88f9-4ffe-a010-6ff72f39235a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48362025-01-13T22:49:52.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 86c7bbd9-b85a-40ef-b481-4439a96ba1b6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48372025-01-13T22:49:52.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 86c7bbd9-b85a-40ef-b481-4439a96ba1b6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48382025-01-13T22:49:52.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 86c7bbd9-b85a-40ef-b481-4439a96ba1b6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48392025-01-13T22:49:53.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = fd2b19f3-2683-400e-be38-db69655ed243 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
48402025-01-13T22:49:53.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9b100ceb-dbfe-4735-9751-cf75c603a47b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48412025-01-13T22:49:53.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9b100ceb-dbfe-4735-9751-cf75c603a47b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48422025-01-13T22:49:53.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9b100ceb-dbfe-4735-9751-cf75c603a47b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48432025-01-13T22:49:54.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dbab3481-a9aa-4843-b634-81e002c0e8a8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48442025-01-13T22:49:54.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dbab3481-a9aa-4843-b634-81e002c0e8a8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48452025-01-13T22:49:54.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dbab3481-a9aa-4843-b634-81e002c0e8a8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48462025-01-13T22:49:55.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac33ac3f-cc4d-47fc-8dcf-6352b1d8623c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48472025-01-13T22:49:55.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac33ac3f-cc4d-47fc-8dcf-6352b1d8623c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48482025-01-13T22:49:55.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ac33ac3f-cc4d-47fc-8dcf-6352b1d8623c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48492025-01-13T22:49:56.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f525f31f-ac72-4fad-85d9-5b419708fef6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48502025-01-13T22:49:56.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f525f31f-ac72-4fad-85d9-5b419708fef6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48512025-01-13T22:49:56.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f525f31f-ac72-4fad-85d9-5b419708fef6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48522025-01-13T22:49:57.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f95bcd2f-0848-4924-af38-75ed2202ea1f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48532025-01-13T22:49:57.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f95bcd2f-0848-4924-af38-75ed2202ea1f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48542025-01-13T22:49:57.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f95bcd2f-0848-4924-af38-75ed2202ea1f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48552025-01-13T22:49:58.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 724cfb2c-ec61-402d-bd05-7bc64a536ce6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48562025-01-13T22:49:58.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 724cfb2c-ec61-402d-bd05-7bc64a536ce6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48572025-01-13T22:49:58.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 724cfb2c-ec61-402d-bd05-7bc64a536ce6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48582025-01-13T22:49:59.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 35d48ebd-3dc2-433a-8350-ed5714b07409 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48592025-01-13T22:49:59.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 35d48ebd-3dc2-433a-8350-ed5714b07409 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48602025-01-13T22:49:59.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 35d48ebd-3dc2-433a-8350-ed5714b07409 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48612025-01-13T22:50:00.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 149839c1-1d1c-4133-bd8c-1d571e9dce97 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48622025-01-13T22:50:00.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 149839c1-1d1c-4133-bd8c-1d571e9dce97 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48632025-01-13T22:50:00.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 149839c1-1d1c-4133-bd8c-1d571e9dce97 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
48642025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
48652025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
48662025-01-13T22:50:01.070ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48672025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48682025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
48692025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48702025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
48712025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48722025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
48732025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48742025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48752025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
48762025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48772025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
48782025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
48792025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48802025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
48812025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48822025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
48832025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
48842025-01-13T22:50:01.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48852025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48862025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
48872025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48882025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48892025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
48902025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48912025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
48922025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48932025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
48942025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48952025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
48962025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48972025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
48982025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
48992025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49002025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49012025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49022025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49032025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49042025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49052025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49062025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49072025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49082025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49092025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49102025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49112025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49122025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49132025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49142025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49152025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49162025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49172025-01-13T22:50:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49182025-01-13T22:50:01.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49192025-01-13T22:50:01.074ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.255962ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49202025-01-13T22:50:01.074ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3060, tv_nsec: 699546226 } })
49212025-01-13T22:50:01.074ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49222025-01-13T22:50:01.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49232025-01-13T22:50:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49242025-01-13T22:50:01.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49252025-01-13T22:50:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49262025-01-13T22:50:01.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49272025-01-13T22:50:01.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49282025-01-13T22:50:01.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49292025-01-13T22:50:01.077ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302025-01-13T22:50:01.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312025-01-13T22:50:01.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49322025-01-13T22:50:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49332025-01-13T22:50:01.079ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49342025-01-13T22:50:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49352025-01-13T22:50:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49362025-01-13T22:50:01.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49372025-01-13T22:50:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49382025-01-13T22:50:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49392025-01-13T22:50:01.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49402025-01-13T22:50:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49412025-01-13T22:50:01.084ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3060, tv_nsec: 709887941 } })
49422025-01-13T22:50:01.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432025-01-13T22:50:01.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49442025-01-13T22:50:01.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49452025-01-13T22:50:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49462025-01-13T22:50:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49472025-01-13T22:50:01.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49482025-01-13T22:50:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49492025-01-13T22:50:01.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49502025-01-13T22:50:01.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49512025-01-13T22:50:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49522025-01-13T22:50:01.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3060, tv_nsec: 715762026 } })
49532025-01-13T22:50:01.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
49542025-01-13T22:50:01.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49552025-01-13T22:50:01.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
49562025-01-13T22:50:01.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49572025-01-13T22:50:01.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582025-01-13T22:50:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49592025-01-13T22:50:01.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49602025-01-13T22:50:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49612025-01-13T22:50:01.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49622025-01-13T22:50:01.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49632025-01-13T22:50:01.114ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
49642025-01-13T22:50:01.114ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.789457ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
49652025-01-13T22:50:01.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.712823ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
49662025-01-13T22:50:01.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49672025-01-13T22:50:01.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49682025-01-13T22:50:01.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.083218ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
49692025-01-13T22:50:01.125ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49702025-01-13T22:50:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49712025-01-13T22:50:01.129ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49722025-01-13T22:50:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49732025-01-13T22:50:01.129ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49742025-01-13T22:50:01.129ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49752025-01-13T22:50:01.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49762025-01-13T22:50:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49772025-01-13T22:50:01.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49782025-01-13T22:50:01.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49792025-01-13T22:50:01.131ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49802025-01-13T22:50:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49812025-01-13T22:50:01.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.277816ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49822025-01-13T22:50:01.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49832025-01-13T22:50:01.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49842025-01-13T22:50:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49852025-01-13T22:50:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49862025-01-13T22:50:01.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49872025-01-13T22:50:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49882025-01-13T22:50:01.136ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49892025-01-13T22:50:01.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49902025-01-13T22:50:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49912025-01-13T22:50:01.138ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49922025-01-13T22:50:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49932025-01-13T22:50:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49942025-01-13T22:50:01.139ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49952025-01-13T22:50:01.139ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.125532ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49962025-01-13T22:50:01.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49972025-01-13T22:50:01.144ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49982025-01-13T22:50:01.145ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cafd7471-45cf-4ff4-88e2-b15dc707b6ee", "content-length": "26", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
49992025-01-13T22:50:01.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50002025-01-13T22:50:01.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50012025-01-13T22:50:01.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50022025-01-13T22:50:01.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50032025-01-13T22:50:01.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.072203ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50042025-01-13T22:50:01.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50052025-01-13T22:50:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50062025-01-13T22:50:01.159ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50072025-01-13T22:50:01.159ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50082025-01-13T22:50:01.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50092025-01-13T22:50:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50102025-01-13T22:50:01.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50112025-01-13T22:50:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50122025-01-13T22:50:01.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.397314ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50132025-01-13T22:50:01.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142025-01-13T22:50:01.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50152025-01-13T22:50:01.164ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50162025-01-13T22:50:01.164ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd45ddf0-7c04-417d-8c6f-b13332cff761", "content-length": "26", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
50172025-01-13T22:50:01.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50182025-01-13T22:50:01.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
50192025-01-13T22:50:01.164ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50202025-01-13T22:50:01.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50212025-01-13T22:50:01.166ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.711349ms iteration = 14 status = 0
50222025-01-13T22:50:01.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50232025-01-13T22:50:01.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 61b64c61-8d3f-471a-9411-d5b4dbc05291 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
50242025-01-13T22:50:01.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 61b64c61-8d3f-471a-9411-d5b4dbc05291 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
50252025-01-13T22:50:01.173ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
50262025-01-13T22:50:01.173ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 102.564585ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
50272025-01-13T22:50:01.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 61b64c61-8d3f-471a-9411-d5b4dbc05291 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
50282025-01-13T22:50:01.181ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 110.260377ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50292025-01-13T22:50:01.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
50302025-01-13T22:50:01.182ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50312025-01-13T22:50:01.182ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83f1d2b2-696b-41a3-9dac-f6d55243afd5", "content-length": "26", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
50322025-01-13T22:50:01.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50332025-01-13T22:50:01.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
50342025-01-13T22:50:01.195ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50352025-01-13T22:50:01.195ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50362025-01-13T22:50:01.195ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.921648ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50372025-01-13T22:50:01.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50382025-01-13T22:50:01.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50392025-01-13T22:50:01.208ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.424481ms iteration = 16 status = {"physical_disks_added":0}
50402025-01-13T22:50:01.239ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50412025-01-13T22:50:01.240ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee344e7d-6af9-460b-8787-c25d8348b682", "content-length": "1", "date": "Mon, 13 Jan 2025 22:50:00 GMT"} })
50422025-01-13T22:50:01.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50432025-01-13T22:50:01.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50442025-01-13T22:50:01.243ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 172.751142ms iteration = 14 status = null
50452025-01-13T22:50:01.273ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.56244ms iteration = 14 status = {}
50462025-01-13T22:50:01.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50472025-01-13T22:50:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50482025-01-13T22:50:01.297ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50492025-01-13T22:50:01.297ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50502025-01-13T22:50:01.297ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "89e2e958-0d12-41ac-bbd7-d104d885ec13", "content-length": "372", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
50512025-01-13T22:50:01.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50522025-01-13T22:50:01.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50532025-01-13T22:50:01.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50542025-01-13T22:50:01.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50552025-01-13T22:50:01.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50562025-01-13T22:50:01.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50572025-01-13T22:50:01.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582025-01-13T22:50:01.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50592025-01-13T22:50:01.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50602025-01-13T22:50:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50612025-01-13T22:50:01.336ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
50622025-01-13T22:50:01.336ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50632025-01-13T22:50:01.336ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "84a9ef7e-2394-4344-abdf-a0b48e5347fd", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
50642025-01-13T22:50:01.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50652025-01-13T22:50:01.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50662025-01-13T22:50:01.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50672025-01-13T22:50:01.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50682025-01-13T22:50:01.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50692025-01-13T22:50:01.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50702025-01-13T22:50:01.345ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50712025-01-13T22:50:01.345ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50722025-01-13T22:50:01.345ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15fdd06d-423b-433c-8197-4854d026ac0b", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
50732025-01-13T22:50:01.347ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.551256ms iteration = 14 status = {}
50742025-01-13T22:50:01.364ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50752025-01-13T22:50:01.364ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c6ab63e-e835-4351-996b-e84813ebded3", "content-length": "691", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
50762025-01-13T22:50:01.364ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50772025-01-13T22:50:01.364ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50782025-01-13T22:50:01.364ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50792025-01-13T22:50:01.366ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 295.369418ms iteration = 14 status = {}
50802025-01-13T22:50:01.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50812025-01-13T22:50:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50822025-01-13T22:50:01.381ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
50832025-01-13T22:50:01.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50842025-01-13T22:50:01.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50852025-01-13T22:50:01.395ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50862025-01-13T22:50:01.396ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bf5c1b5-b0ff-46e9-a592-94b1bb096b55", "content-length": "134", "date": "Mon, 13 Jan 2025 22:50:00 GMT"} })
50872025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50882025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
50892025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50902025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50912025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50922025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50932025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50942025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50952025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50962025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50972025-01-13T22:50:01.396ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
50982025-01-13T22:50:01.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50992025-01-13T22:50:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51002025-01-13T22:50:01.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51012025-01-13T22:50:01.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d0bf472-c1a1-4c8f-b879-e06dda663fab", "content-length": "2", "date": "Mon, 13 Jan 2025 22:50:00 GMT"} })
51022025-01-13T22:50:01.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51032025-01-13T22:50:01.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc942b33-bad4-4b28-9eb2-08a06c6e08b2", "content-length": "51", "date": "Mon, 13 Jan 2025 22:50:00 GMT"} })
51042025-01-13T22:50:01.399ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
51052025-01-13T22:50:01.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51062025-01-13T22:50:01.490ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2fc66890-d666-4dfd-855d-6069a70a3848", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
51072025-01-13T22:50:01.490ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
51082025-01-13T22:50:01.490ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51092025-01-13T22:50:01.490ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "69f9ab40-a74a-465d-a52a-fbd4a12e2ab9", "content-length": "682", "date": "Mon, 13 Jan 2025 22:50:01 GMT"} })
51102025-01-13T22:50:01.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51112025-01-13T22:50:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51122025-01-13T22:50:01.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51132025-01-13T22:50:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51142025-01-13T22:50:01.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51152025-01-13T22:50:01.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51162025-01-13T22:50:01.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51172025-01-13T22:50:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51182025-01-13T22:50:01.508ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 437.390964ms iteration = 14 status = {}
51192025-01-13T22:50:01.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 941d2017-6a16-4fdf-b0d8-04b725a37ec2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51202025-01-13T22:50:01.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 941d2017-6a16-4fdf-b0d8-04b725a37ec2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51212025-01-13T22:50:01.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 941d2017-6a16-4fdf-b0d8-04b725a37ec2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51222025-01-13T22:50:02.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69f94575-91bf-4dad-a356-6cdf3ccad5ca roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51232025-01-13T22:50:02.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69f94575-91bf-4dad-a356-6cdf3ccad5ca resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51242025-01-13T22:50:02.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69f94575-91bf-4dad-a356-6cdf3ccad5ca response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51252025-01-13T22:50:03.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = e98a46b4-060a-470c-a7c3-8db9550bbcb0 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
51262025-01-13T22:50:03.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = daa4d6f2-57ae-4787-9ba9-66326d29012c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51272025-01-13T22:50:03.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = daa4d6f2-57ae-4787-9ba9-66326d29012c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51282025-01-13T22:50:03.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = daa4d6f2-57ae-4787-9ba9-66326d29012c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51292025-01-13T22:50:04.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 93bef192-ad1c-4a04-a414-e6c6749e43c5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51302025-01-13T22:50:04.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 93bef192-ad1c-4a04-a414-e6c6749e43c5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51312025-01-13T22:50:04.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 93bef192-ad1c-4a04-a414-e6c6749e43c5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51322025-01-13T22:50:05.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 838032db-3268-4b8b-a1d4-0cc316af04b1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51332025-01-13T22:50:05.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 838032db-3268-4b8b-a1d4-0cc316af04b1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51342025-01-13T22:50:05.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 838032db-3268-4b8b-a1d4-0cc316af04b1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51352025-01-13T22:50:06.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 248a6547-ac30-4fb4-a9cf-c2fe7b2a1505 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51362025-01-13T22:50:06.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 248a6547-ac30-4fb4-a9cf-c2fe7b2a1505 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51372025-01-13T22:50:06.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 248a6547-ac30-4fb4-a9cf-c2fe7b2a1505 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51382025-01-13T22:50:07.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 152a494d-0d73-44da-9a99-d7c108fc93ba roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51392025-01-13T22:50:07.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 152a494d-0d73-44da-9a99-d7c108fc93ba resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51402025-01-13T22:50:07.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 152a494d-0d73-44da-9a99-d7c108fc93ba response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51412025-01-13T22:50:08.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6adcf7be-d61a-4fd3-a936-11655a0e303f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51422025-01-13T22:50:08.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6adcf7be-d61a-4fd3-a936-11655a0e303f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51432025-01-13T22:50:08.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6adcf7be-d61a-4fd3-a936-11655a0e303f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51442025-01-13T22:50:09.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ddd1d2ca-1985-4e31-9941-af715881f6c8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51452025-01-13T22:50:09.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ddd1d2ca-1985-4e31-9941-af715881f6c8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51462025-01-13T22:50:09.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ddd1d2ca-1985-4e31-9941-af715881f6c8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51472025-01-13T22:50:10.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa8c6383-a3aa-42cd-be22-6580e29fa41d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51482025-01-13T22:50:10.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa8c6383-a3aa-42cd-be22-6580e29fa41d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51492025-01-13T22:50:10.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa8c6383-a3aa-42cd-be22-6580e29fa41d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51502025-01-13T22:50:11.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
51512025-01-13T22:50:11.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
51522025-01-13T22:50:11.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51532025-01-13T22:50:11.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51542025-01-13T22:50:11.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51552025-01-13T22:50:11.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51562025-01-13T22:50:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51572025-01-13T22:50:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51582025-01-13T22:50:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51592025-01-13T22:50:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51602025-01-13T22:50:11.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51612025-01-13T22:50:11.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51622025-01-13T22:50:11.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632025-01-13T22:50:11.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
51642025-01-13T22:50:11.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51652025-01-13T22:50:11.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51662025-01-13T22:50:11.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
51672025-01-13T22:50:11.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.036165ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
51682025-01-13T22:50:11.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51692025-01-13T22:50:11.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51702025-01-13T22:50:11.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.968413ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51712025-01-13T22:50:11.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d7f85b6-050b-4337-b9f0-12d659a3c295 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51722025-01-13T22:50:11.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d7f85b6-050b-4337-b9f0-12d659a3c295 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51732025-01-13T22:50:11.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d7f85b6-050b-4337-b9f0-12d659a3c295 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51742025-01-13T22:50:12.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 738968d9-ac86-4592-9a6c-9b9de512f553 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51752025-01-13T22:50:12.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 738968d9-ac86-4592-9a6c-9b9de512f553 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51762025-01-13T22:50:12.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 738968d9-ac86-4592-9a6c-9b9de512f553 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51772025-01-13T22:50:13.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 0aa56ccb-5c1f-46e4-b21c-25dcce318309 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
51782025-01-13T22:50:13.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 0aa56ccb-5c1f-46e4-b21c-25dcce318309 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
51792025-01-13T22:50:13.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 0aa56ccb-5c1f-46e4-b21c-25dcce318309 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
51802025-01-13T22:50:13.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 03002f79-58ec-46c4-977a-afc1cbd24e94 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
51812025-01-13T22:50:13.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 03002f79-58ec-46c4-977a-afc1cbd24e94 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
51822025-01-13T22:50:13.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 03002f79-58ec-46c4-977a-afc1cbd24e94 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
51832025-01-13T22:50:13.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 92dc7b1c-b88e-4e99-8cda-26efb1989d62 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
51842025-01-13T22:50:13.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5ee18131-7e52-4b9f-9b25-c7319fee89c3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51852025-01-13T22:50:13.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5ee18131-7e52-4b9f-9b25-c7319fee89c3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51862025-01-13T22:50:13.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5ee18131-7e52-4b9f-9b25-c7319fee89c3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51872025-01-13T22:50:14.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = af49c4cf-c19d-47ca-99b7-b196bbc221f3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51882025-01-13T22:50:14.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = af49c4cf-c19d-47ca-99b7-b196bbc221f3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51892025-01-13T22:50:14.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2770 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = af49c4cf-c19d-47ca-99b7-b196bbc221f3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51902025-01-13T22:50:16.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 45b201a7-f914-4910-846b-82ff333672dd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51912025-01-13T22:50:16.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 45b201a7-f914-4910-846b-82ff333672dd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51922025-01-13T22:50:16.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 45b201a7-f914-4910-846b-82ff333672dd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51932025-01-13T22:50:17.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ee19c20a-4dd2-4f9b-8d2d-e879812f44d5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51942025-01-13T22:50:17.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ee19c20a-4dd2-4f9b-8d2d-e879812f44d5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51952025-01-13T22:50:17.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ee19c20a-4dd2-4f9b-8d2d-e879812f44d5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51962025-01-13T22:50:18.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3006b999-e206-4c21-a4aa-2ba395327b4d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51972025-01-13T22:50:18.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3006b999-e206-4c21-a4aa-2ba395327b4d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51982025-01-13T22:50:18.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3006b999-e206-4c21-a4aa-2ba395327b4d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
51992025-01-13T22:50:19.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb8284b6-1d23-4883-8047-5dd0eaa6d6c6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52002025-01-13T22:50:19.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb8284b6-1d23-4883-8047-5dd0eaa6d6c6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52012025-01-13T22:50:19.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb8284b6-1d23-4883-8047-5dd0eaa6d6c6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52022025-01-13T22:50:20.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 17e865e2-b35d-43bc-b975-70d516d3c75e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52032025-01-13T22:50:20.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 17e865e2-b35d-43bc-b975-70d516d3c75e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52042025-01-13T22:50:20.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 17e865e2-b35d-43bc-b975-70d516d3c75e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52052025-01-13T22:50:21.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
52062025-01-13T22:50:21.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52072025-01-13T22:50:21.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
52082025-01-13T22:50:21.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52092025-01-13T22:50:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52102025-01-13T22:50:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52112025-01-13T22:50:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52122025-01-13T22:50:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52132025-01-13T22:50:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52142025-01-13T22:50:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52152025-01-13T22:50:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52162025-01-13T22:50:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52172025-01-13T22:50:21.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52182025-01-13T22:50:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
52192025-01-13T22:50:21.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52202025-01-13T22:50:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52212025-01-13T22:50:21.096ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
52222025-01-13T22:50:21.096ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.363579ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
52232025-01-13T22:50:21.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52242025-01-13T22:50:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52252025-01-13T22:50:21.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3b7b1cb-06be-48a5-9ae6-3d715fb246cd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52262025-01-13T22:50:21.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3b7b1cb-06be-48a5-9ae6-3d715fb246cd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52272025-01-13T22:50:21.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3b7b1cb-06be-48a5-9ae6-3d715fb246cd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52282025-01-13T22:50:21.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.678533ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52292025-01-13T22:50:22.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c2b3321-b04a-49e6-b8b4-0b8f53b77ade roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52302025-01-13T22:50:22.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c2b3321-b04a-49e6-b8b4-0b8f53b77ade resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52312025-01-13T22:50:22.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c2b3321-b04a-49e6-b8b4-0b8f53b77ade response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52322025-01-13T22:50:23.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3054215f-2a2e-447d-a1d8-c35c150772fb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52332025-01-13T22:50:23.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3054215f-2a2e-447d-a1d8-c35c150772fb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52342025-01-13T22:50:23.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3054215f-2a2e-447d-a1d8-c35c150772fb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52352025-01-13T22:50:23.510ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = d87befbe-e909-4164-abde-52382edc5495 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
52362025-01-13T22:50:24.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6eadaca6-aa13-4e1f-883f-96db47ba077f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52372025-01-13T22:50:24.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6eadaca6-aa13-4e1f-883f-96db47ba077f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52382025-01-13T22:50:24.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6eadaca6-aa13-4e1f-883f-96db47ba077f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52392025-01-13T22:50:25.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46fd62a8-750d-4bc0-be3a-b312f4cebae2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52402025-01-13T22:50:25.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46fd62a8-750d-4bc0-be3a-b312f4cebae2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52412025-01-13T22:50:25.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 46fd62a8-750d-4bc0-be3a-b312f4cebae2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52422025-01-13T22:50:26.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 120e3f86-03b1-47ad-862f-e6c56725bb12 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52432025-01-13T22:50:26.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 120e3f86-03b1-47ad-862f-e6c56725bb12 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52442025-01-13T22:50:26.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 120e3f86-03b1-47ad-862f-e6c56725bb12 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52452025-01-13T22:50:27.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 357c4df6-cb4c-4123-8159-481bff754f76 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52462025-01-13T22:50:27.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 357c4df6-cb4c-4123-8159-481bff754f76 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52472025-01-13T22:50:27.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 357c4df6-cb4c-4123-8159-481bff754f76 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52482025-01-13T22:50:28.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 14f223dd-2c58-4841-beea-ebf373e1eef2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52492025-01-13T22:50:28.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 14f223dd-2c58-4841-beea-ebf373e1eef2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52502025-01-13T22:50:28.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 14f223dd-2c58-4841-beea-ebf373e1eef2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52512025-01-13T22:50:29.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dd695c0-cf43-474b-b734-3a591fd19f12 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52522025-01-13T22:50:29.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dd695c0-cf43-474b-b734-3a591fd19f12 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52532025-01-13T22:50:29.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5dd695c0-cf43-474b-b734-3a591fd19f12 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52542025-01-13T22:50:30.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 90666a90-45eb-49c8-9cc9-e13ba56cd589 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52552025-01-13T22:50:30.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 90666a90-45eb-49c8-9cc9-e13ba56cd589 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52562025-01-13T22:50:30.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 90666a90-45eb-49c8-9cc9-e13ba56cd589 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
52572025-01-13T22:50:31.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
52582025-01-13T22:50:31.068ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52592025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52602025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
52612025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
52622025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
52632025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52642025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
52652025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52662025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
52672025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52682025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
52692025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52702025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52712025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52722025-01-13T22:50:31.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3090, tv_nsec: 694988003 } })
52732025-01-13T22:50:31.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3090, tv_nsec: 695106486 } })
52742025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
52752025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
52762025-01-13T22:50:31.069ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
52772025-01-13T22:50:31.069ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52782025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
52792025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.601\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
52802025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52812025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52822025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
52832025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
52842025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52852025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52862025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
52872025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
52882025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52892025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
52902025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52912025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52922025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
52932025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
52942025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
52952025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
52962025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52972025-01-13T22:50:31.069ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:40:31.069816099 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52982025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52992025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53002025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
53012025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53022025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
53032025-01-13T22:50:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
53042025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53052025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53062025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
53072025-01-13T22:50:31.070ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53082025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53092025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
53102025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53112025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
53122025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53132025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
53142025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53152025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
53162025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53172025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
53182025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53192025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
53202025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53212025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53222025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
53232025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53242025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
53252025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53262025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53272025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.175647ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53282025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53292025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
53302025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.299961ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
53312025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53322025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53332025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53342025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53352025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53362025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53372025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53382025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53392025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53402025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53412025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53422025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53432025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53442025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53452025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53462025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53472025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53482025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53492025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53502025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53512025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53522025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53532025-01-13T22:50:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53542025-01-13T22:50:31.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53552025-01-13T22:50:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53562025-01-13T22:50:31.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53572025-01-13T22:50:31.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53582025-01-13T22:50:31.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53592025-01-13T22:50:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53602025-01-13T22:50:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53612025-01-13T22:50:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53622025-01-13T22:50:31.074ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53632025-01-13T22:50:31.075ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.250015ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53642025-01-13T22:50:31.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53652025-01-13T22:50:31.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53662025-01-13T22:50:31.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.35472ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
53672025-01-13T22:50:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53682025-01-13T22:50:31.076ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53692025-01-13T22:50:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53702025-01-13T22:50:31.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53712025-01-13T22:50:31.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53722025-01-13T22:50:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53732025-01-13T22:50:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53742025-01-13T22:50:31.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53752025-01-13T22:50:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53762025-01-13T22:50:31.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53772025-01-13T22:50:31.080ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3090, tv_nsec: 706358060 } })
53782025-01-13T22:50:31.081ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53792025-01-13T22:50:31.081ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3090, tv_nsec: 707317010 } })
53802025-01-13T22:50:31.081ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53812025-01-13T22:50:31.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53822025-01-13T22:50:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53832025-01-13T22:50:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53842025-01-13T22:50:31.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53852025-01-13T22:50:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53862025-01-13T22:50:31.091ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:40:31.069816099 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53872025-01-13T22:50:31.091ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.443144ms iteration = 8 status = {"expiration":"2025-01-13T22:40:31.069816099Z","pruned":[]}
53882025-01-13T22:50:31.091ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.963651ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
53892025-01-13T22:50:31.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53902025-01-13T22:50:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53912025-01-13T22:50:31.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53922025-01-13T22:50:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53932025-01-13T22:50:31.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942025-01-13T22:50:31.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952025-01-13T22:50:31.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53962025-01-13T22:50:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53972025-01-13T22:50:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53982025-01-13T22:50:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53992025-01-13T22:50:31.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54002025-01-13T22:50:31.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54012025-01-13T22:50:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54022025-01-13T22:50:31.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54032025-01-13T22:50:31.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54042025-01-13T22:50:31.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54052025-01-13T22:50:31.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54062025-01-13T22:50:31.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54072025-01-13T22:50:31.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54082025-01-13T22:50:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
54092025-01-13T22:50:31.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54102025-01-13T22:50:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54112025-01-13T22:50:31.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.982462ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
54122025-01-13T22:50:31.131ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54132025-01-13T22:50:31.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54142025-01-13T22:50:31.135ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54152025-01-13T22:50:31.135ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54162025-01-13T22:50:31.135ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54172025-01-13T22:50:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54182025-01-13T22:50:31.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192025-01-13T22:50:31.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.559486ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54202025-01-13T22:50:31.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54212025-01-13T22:50:31.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54222025-01-13T22:50:31.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232025-01-13T22:50:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54242025-01-13T22:50:31.140ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54252025-01-13T22:50:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54262025-01-13T22:50:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54272025-01-13T22:50:31.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54282025-01-13T22:50:31.142ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54292025-01-13T22:50:31.142ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54302025-01-13T22:50:31.142ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54312025-01-13T22:50:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54322025-01-13T22:50:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54332025-01-13T22:50:31.143ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54342025-01-13T22:50:31.145ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3090, tv_nsec: 770760635 } })
54352025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54362025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54372025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54382025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54392025-01-13T22:50:31.145ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
54402025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
54412025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.940288ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
54422025-01-13T22:50:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54432025-01-13T22:50:31.146ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54442025-01-13T22:50:31.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54452025-01-13T22:50:31.147ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54462025-01-13T22:50:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54472025-01-13T22:50:31.148ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54482025-01-13T22:50:31.148ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54492025-01-13T22:50:31.148ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54502025-01-13T22:50:31.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54512025-01-13T22:50:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54522025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54532025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54542025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54552025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54562025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54572025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54582025-01-13T22:50:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54592025-01-13T22:50:31.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54602025-01-13T22:50:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54612025-01-13T22:50:31.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54622025-01-13T22:50:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54632025-01-13T22:50:31.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642025-01-13T22:50:31.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.092682ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54652025-01-13T22:50:31.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54662025-01-13T22:50:31.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54672025-01-13T22:50:31.162ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54682025-01-13T22:50:31.162ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54692025-01-13T22:50:31.162ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 92.631313ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54702025-01-13T22:50:31.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.034806ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54712025-01-13T22:50:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54722025-01-13T22:50:31.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54732025-01-13T22:50:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54742025-01-13T22:50:31.164ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54752025-01-13T22:50:31.164ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.271415ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54762025-01-13T22:50:31.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54772025-01-13T22:50:31.166ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54782025-01-13T22:50:31.166ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54792025-01-13T22:50:31.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54802025-01-13T22:50:31.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54812025-01-13T22:50:31.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822025-01-13T22:50:31.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54832025-01-13T22:50:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
54842025-01-13T22:50:31.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54852025-01-13T22:50:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54862025-01-13T22:50:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54872025-01-13T22:50:31.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54882025-01-13T22:50:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54892025-01-13T22:50:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54902025-01-13T22:50:31.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54912025-01-13T22:50:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54922025-01-13T22:50:31.175ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.302202ms iteration = 15 status = 0
54932025-01-13T22:50:31.175ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54942025-01-13T22:50:31.175ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54952025-01-13T22:50:31.175ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
54962025-01-13T22:50:31.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 106.907012ms iteration = 8 status = {"generation":1}
54972025-01-13T22:50:31.177ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54982025-01-13T22:50:31.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54992025-01-13T22:50:31.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55002025-01-13T22:50:31.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55012025-01-13T22:50:31.191ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55022025-01-13T22:50:31.191ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55032025-01-13T22:50:31.191ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.499591ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55042025-01-13T22:50:31.192ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55052025-01-13T22:50:31.192ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55062025-01-13T22:50:31.192ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55072025-01-13T22:50:31.192ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.45475ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55082025-01-13T22:50:31.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55092025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55102025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55112025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55122025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55132025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55142025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55152025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55162025-01-13T22:50:31.195ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55172025-01-13T22:50:31.196ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55182025-01-13T22:50:31.196ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
55192025-01-13T22:50:31.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55202025-01-13T22:50:31.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55212025-01-13T22:50:31.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55222025-01-13T22:50:31.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55232025-01-13T22:50:31.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55242025-01-13T22:50:31.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55252025-01-13T22:50:31.202ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
55262025-01-13T22:50:31.202ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55272025-01-13T22:50:31.202ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
55282025-01-13T22:50:31.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 133.372154ms iteration = 8 status = {"generation":2}
55292025-01-13T22:50:31.202ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55302025-01-13T22:50:31.202ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55312025-01-13T22:50:31.202ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "166f3886-8da6-4c2a-a6b1-05927ac64f18", "content-length": "26", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
55322025-01-13T22:50:31.202ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55332025-01-13T22:50:31.204ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55342025-01-13T22:50:31.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 03329048-6f8a-413f-a83f-89d585bbba39 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55352025-01-13T22:50:31.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 03329048-6f8a-413f-a83f-89d585bbba39 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55362025-01-13T22:50:31.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 03329048-6f8a-413f-a83f-89d585bbba39 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55372025-01-13T22:50:31.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55382025-01-13T22:50:31.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55392025-01-13T22:50:31.222ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55402025-01-13T22:50:31.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.769804ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
55412025-01-13T22:50:31.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55422025-01-13T22:50:31.223ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55432025-01-13T22:50:31.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55442025-01-13T22:50:31.228ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
55452025-01-13T22:50:31.228ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 158.420732ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
55462025-01-13T22:50:31.250ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55472025-01-13T22:50:31.250ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55482025-01-13T22:50:31.251ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e68a8658-ec4e-4f1d-9ec6-3198fb210f45", "content-length": "26", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
55492025-01-13T22:50:31.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55502025-01-13T22:50:31.252ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55512025-01-13T22:50:31.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55522025-01-13T22:50:31.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55532025-01-13T22:50:31.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55542025-01-13T22:50:31.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55552025-01-13T22:50:31.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55562025-01-13T22:50:31.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55572025-01-13T22:50:31.266ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
55582025-01-13T22:50:31.266ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 197.849191ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55592025-01-13T22:50:31.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55602025-01-13T22:50:31.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55612025-01-13T22:50:31.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55622025-01-13T22:50:31.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55632025-01-13T22:50:31.281ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55642025-01-13T22:50:31.281ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 211.522952ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55652025-01-13T22:50:31.298ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.67343ms iteration = 17 status = {"physical_disks_added":0}
55662025-01-13T22:50:31.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1d5acf94-dd3d-4533-9a8a-b763bc488c21 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
55672025-01-13T22:50:31.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1d5acf94-dd3d-4533-9a8a-b763bc488c21 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
55682025-01-13T22:50:31.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1d5acf94-dd3d-4533-9a8a-b763bc488c21 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
55692025-01-13T22:50:31.370ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55702025-01-13T22:50:31.370ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "adc137e3-14e3-470e-bc7e-f624d90aa2f7", "content-length": "1", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
55712025-01-13T22:50:31.371ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55722025-01-13T22:50:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55732025-01-13T22:50:31.374ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 304.245437ms iteration = 15 status = null
55742025-01-13T22:50:31.417ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55752025-01-13T22:50:31.417ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "10b91958-0126-46c7-ae59-0cc9dee584f4", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55762025-01-13T22:50:31.417ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55772025-01-13T22:50:31.419ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "67fb735a-2c95-47fe-9ecd-c4249182c085", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55782025-01-13T22:50:31.419ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55792025-01-13T22:50:31.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
55802025-01-13T22:50:31.420ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55812025-01-13T22:50:31.420ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "354aff4b-4361-4325-b31f-8702107c8f8f", "content-length": "26", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
55822025-01-13T22:50:31.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55832025-01-13T22:50:31.420ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55842025-01-13T22:50:31.420ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 351.801493ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55852025-01-13T22:50:31.421ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
55862025-01-13T22:50:31.445ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55872025-01-13T22:50:31.445ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55882025-01-13T22:50:31.445ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8439a9df-9893-493f-b9f8-9a2fb183929a", "content-length": "372", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} })
55892025-01-13T22:50:31.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55902025-01-13T22:50:31.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55912025-01-13T22:50:31.459ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55922025-01-13T22:50:31.468ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55932025-01-13T22:50:31.468ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55942025-01-13T22:50:31.468ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ae032381-d2ef-4093-ac5d-8fabb3b486be", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} })
55952025-01-13T22:50:31.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55962025-01-13T22:50:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55972025-01-13T22:50:31.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55982025-01-13T22:50:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55992025-01-13T22:50:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 422.63585ms iteration = 15 status = {}
56002025-01-13T22:50:31.561ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56012025-01-13T22:50:31.562ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "179a0c3f-e9d6-4932-9b50-30f4e4730e5b", "content-length": "691", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} })
56022025-01-13T22:50:31.562ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56032025-01-13T22:50:31.562ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56042025-01-13T22:50:31.562ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56052025-01-13T22:50:31.564ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.438728ms iteration = 15 status = {}
56062025-01-13T22:50:31.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56072025-01-13T22:50:31.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56082025-01-13T22:50:31.566ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56092025-01-13T22:50:31.566ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56102025-01-13T22:50:31.567ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "404c2faf-011e-4721-9746-2c2f05076245", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} })
56112025-01-13T22:50:31.568ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 498.591569ms iteration = 15 status = {}
56122025-01-13T22:50:31.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56132025-01-13T22:50:31.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "390e717c-8ee5-4575-977f-4339bb7bb890", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56142025-01-13T22:50:31.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56152025-01-13T22:50:31.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "130a4c9d-0ad5-4107-bcc3-8f2612d930ba", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56162025-01-13T22:50:31.596ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56172025-01-13T22:50:31.598ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f6087732-61ec-48ed-8c80-5d34101f17a1", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56182025-01-13T22:50:31.598ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56192025-01-13T22:50:31.600ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56202025-01-13T22:50:31.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 531.70421ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56212025-01-13T22:50:31.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56222025-01-13T22:50:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56232025-01-13T22:50:31.635ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
56242025-01-13T22:50:31.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56252025-01-13T22:50:31.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56262025-01-13T22:50:31.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56272025-01-13T22:50:31.643ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "775c341b-5641-4296-8903-926100ab8373", "content-length": "134", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
56282025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56292025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
56302025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56312025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56322025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56332025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56342025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56352025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56362025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56372025-01-13T22:50:31.643ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56382025-01-13T22:50:31.644ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
56392025-01-13T22:50:31.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402025-01-13T22:50:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412025-01-13T22:50:31.645ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56422025-01-13T22:50:31.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bafc68c9-1ca8-4a38-adac-08f19e5c2d32", "content-length": "2", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
56432025-01-13T22:50:31.646ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56442025-01-13T22:50:31.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "effe2426-490c-4607-9a9b-bf1e83ad4128", "content-length": "51", "date": "Mon, 13 Jan 2025 22:50:30 GMT"} })
56452025-01-13T22:50:31.646ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
56462025-01-13T22:50:31.646ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56472025-01-13T22:50:31.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "91e38ff6-2240-4699-91b0-fa9b3a9b6b9c", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} })
56482025-01-13T22:50:31.739ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
56492025-01-13T22:50:31.739ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56502025-01-13T22:50:31.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "38ae876d-29e7-44d6-915b-c49c27161efe", "content-length": "682", "date": "Mon, 13 Jan 2025 22:50:31 GMT"} })
56512025-01-13T22:50:31.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56522025-01-13T22:50:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56532025-01-13T22:50:31.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56542025-01-13T22:50:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56552025-01-13T22:50:31.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56562025-01-13T22:50:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56572025-01-13T22:50:31.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56582025-01-13T22:50:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56592025-01-13T22:50:31.755ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 685.29442ms iteration = 15 status = {}
56602025-01-13T22:50:32.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9aa951be-3366-406a-ab66-9a68ceff61b3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56612025-01-13T22:50:32.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9aa951be-3366-406a-ab66-9a68ceff61b3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56622025-01-13T22:50:32.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9aa951be-3366-406a-ab66-9a68ceff61b3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56632025-01-13T22:50:33.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 989d37d7-15ad-4a5d-ae96-2cce8844db11 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56642025-01-13T22:50:33.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 989d37d7-15ad-4a5d-ae96-2cce8844db11 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56652025-01-13T22:50:33.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 989d37d7-15ad-4a5d-ae96-2cce8844db11 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56662025-01-13T22:50:33.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = f1eed3fc-d7dc-4ce5-922a-fdf9155b66f0 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
56672025-01-13T22:50:34.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f8e6cdcb-1255-45d9-91fd-2f1192e2ca2c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56682025-01-13T22:50:34.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f8e6cdcb-1255-45d9-91fd-2f1192e2ca2c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56692025-01-13T22:50:34.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f8e6cdcb-1255-45d9-91fd-2f1192e2ca2c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56702025-01-13T22:50:35.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec0b4316-77dd-44bb-9d9d-08c6c39e1fc7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56712025-01-13T22:50:35.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec0b4316-77dd-44bb-9d9d-08c6c39e1fc7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56722025-01-13T22:50:35.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ec0b4316-77dd-44bb-9d9d-08c6c39e1fc7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56732025-01-13T22:50:36.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12bf1828-d3c5-4c5e-838a-be73eb276197 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56742025-01-13T22:50:36.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12bf1828-d3c5-4c5e-838a-be73eb276197 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56752025-01-13T22:50:36.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 12bf1828-d3c5-4c5e-838a-be73eb276197 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56762025-01-13T22:50:37.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a226dae3-839b-4041-bca9-77afa7e0ed96 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56772025-01-13T22:50:37.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a226dae3-839b-4041-bca9-77afa7e0ed96 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56782025-01-13T22:50:37.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a226dae3-839b-4041-bca9-77afa7e0ed96 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56792025-01-13T22:50:38.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1b841a-37cc-465f-8b00-beb7cc3095e3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56802025-01-13T22:50:38.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1b841a-37cc-465f-8b00-beb7cc3095e3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56812025-01-13T22:50:38.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1b841a-37cc-465f-8b00-beb7cc3095e3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56822025-01-13T22:50:39.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8fbfc078-7204-4647-aad0-74746603c678 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56832025-01-13T22:50:39.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8fbfc078-7204-4647-aad0-74746603c678 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56842025-01-13T22:50:39.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8fbfc078-7204-4647-aad0-74746603c678 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56852025-01-13T22:50:40.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36ca72a0-f222-41e0-a3ef-e6e3c126cf4d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56862025-01-13T22:50:40.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36ca72a0-f222-41e0-a3ef-e6e3c126cf4d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56872025-01-13T22:50:40.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36ca72a0-f222-41e0-a3ef-e6e3c126cf4d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
56882025-01-13T22:50:41.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
56892025-01-13T22:50:41.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
56902025-01-13T22:50:41.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56912025-01-13T22:50:41.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56922025-01-13T22:50:41.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56932025-01-13T22:50:41.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56942025-01-13T22:50:41.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56952025-01-13T22:50:41.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56962025-01-13T22:50:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56972025-01-13T22:50:41.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.605095ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56982025-01-13T22:50:41.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56992025-01-13T22:50:41.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57002025-01-13T22:50:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57012025-01-13T22:50:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57022025-01-13T22:50:41.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57032025-01-13T22:50:41.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57042025-01-13T22:50:41.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
57052025-01-13T22:50:41.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57062025-01-13T22:50:41.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57072025-01-13T22:50:41.090ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
57082025-01-13T22:50:41.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.893356ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
57092025-01-13T22:50:41.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8dcd0d1-38bf-469f-8917-ff6500d8c336 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57102025-01-13T22:50:41.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8dcd0d1-38bf-469f-8917-ff6500d8c336 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57112025-01-13T22:50:41.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a8dcd0d1-38bf-469f-8917-ff6500d8c336 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57122025-01-13T22:50:42.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c34631a2-b2aa-42ac-94c7-52ae3aa9b130 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57132025-01-13T22:50:42.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c34631a2-b2aa-42ac-94c7-52ae3aa9b130 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57142025-01-13T22:50:42.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c34631a2-b2aa-42ac-94c7-52ae3aa9b130 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57152025-01-13T22:50:43.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = ea5b0867-3b07-4cc9-8ca3-b2a2b0446c53 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
57162025-01-13T22:50:43.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c70e3c82-3d3c-4727-977f-bef2d0e2a631 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57172025-01-13T22:50:43.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c70e3c82-3d3c-4727-977f-bef2d0e2a631 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57182025-01-13T22:50:43.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c70e3c82-3d3c-4727-977f-bef2d0e2a631 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57192025-01-13T22:50:44.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cf9db797-568c-4266-960c-054e2b583833 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57202025-01-13T22:50:44.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cf9db797-568c-4266-960c-054e2b583833 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57212025-01-13T22:50:44.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cf9db797-568c-4266-960c-054e2b583833 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57222025-01-13T22:50:45.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 771dabcc-6e5f-4a3f-82b2-3e0969a0618a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57232025-01-13T22:50:45.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 771dabcc-6e5f-4a3f-82b2-3e0969a0618a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57242025-01-13T22:50:45.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 771dabcc-6e5f-4a3f-82b2-3e0969a0618a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57252025-01-13T22:50:46.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4a44b803-0d94-4c73-b98b-17eb92578803 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57262025-01-13T22:50:46.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4a44b803-0d94-4c73-b98b-17eb92578803 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57272025-01-13T22:50:46.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4a44b803-0d94-4c73-b98b-17eb92578803 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57282025-01-13T22:50:47.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 897f8e20-d873-4c37-abb6-d9445d280563 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57292025-01-13T22:50:47.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 897f8e20-d873-4c37-abb6-d9445d280563 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57302025-01-13T22:50:47.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 897f8e20-d873-4c37-abb6-d9445d280563 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57312025-01-13T22:50:48.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4b8ee7c-3c56-43e3-a835-633a0d6512ae roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57322025-01-13T22:50:48.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4b8ee7c-3c56-43e3-a835-633a0d6512ae resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57332025-01-13T22:50:48.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4b8ee7c-3c56-43e3-a835-633a0d6512ae response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57342025-01-13T22:50:49.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d8873bc5-3505-44c3-bc32-b908b78b2c8c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57352025-01-13T22:50:49.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d8873bc5-3505-44c3-bc32-b908b78b2c8c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57362025-01-13T22:50:49.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d8873bc5-3505-44c3-bc32-b908b78b2c8c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57372025-01-13T22:50:50.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8b999706-9b43-45a3-810a-fa85009a7361 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57382025-01-13T22:50:50.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8b999706-9b43-45a3-810a-fa85009a7361 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57392025-01-13T22:50:50.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8b999706-9b43-45a3-810a-fa85009a7361 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57402025-01-13T22:50:51.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
57412025-01-13T22:50:51.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
57422025-01-13T22:50:51.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57432025-01-13T22:50:51.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57442025-01-13T22:50:51.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57452025-01-13T22:50:51.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57462025-01-13T22:50:51.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57472025-01-13T22:50:51.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57482025-01-13T22:50:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57492025-01-13T22:50:51.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.923624ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57502025-01-13T22:50:51.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57512025-01-13T22:50:51.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57522025-01-13T22:50:51.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57532025-01-13T22:50:51.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57542025-01-13T22:50:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57552025-01-13T22:50:51.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57562025-01-13T22:50:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
57572025-01-13T22:50:51.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57582025-01-13T22:50:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57592025-01-13T22:50:51.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
57602025-01-13T22:50:51.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.072249ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
57612025-01-13T22:50:51.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43b94f98-0f8a-445b-863a-6dcedd0d5704 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57622025-01-13T22:50:51.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43b94f98-0f8a-445b-863a-6dcedd0d5704 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57632025-01-13T22:50:51.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43b94f98-0f8a-445b-863a-6dcedd0d5704 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57642025-01-13T22:50:52.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9b1bf2f-13b2-47c1-b646-6096ad398717 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57652025-01-13T22:50:52.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9b1bf2f-13b2-47c1-b646-6096ad398717 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57662025-01-13T22:50:52.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9b1bf2f-13b2-47c1-b646-6096ad398717 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57672025-01-13T22:50:53.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 9db9958a-3915-4586-b4e0-45c2ee3b486b response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
57682025-01-13T22:50:53.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fb13f420-1126-4fc8-bed0-cbb379d78fba roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57692025-01-13T22:50:53.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fb13f420-1126-4fc8-bed0-cbb379d78fba resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57702025-01-13T22:50:53.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fb13f420-1126-4fc8-bed0-cbb379d78fba response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57712025-01-13T22:50:54.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4c5884d4-7909-474a-9cd4-80d610f5004d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57722025-01-13T22:50:54.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4c5884d4-7909-474a-9cd4-80d610f5004d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57732025-01-13T22:50:54.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4c5884d4-7909-474a-9cd4-80d610f5004d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57742025-01-13T22:50:55.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4ba5a6c-ddf1-44be-b008-81d20c269934 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57752025-01-13T22:50:55.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4ba5a6c-ddf1-44be-b008-81d20c269934 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57762025-01-13T22:50:55.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4ba5a6c-ddf1-44be-b008-81d20c269934 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57772025-01-13T22:50:56.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 89b26ec4-6f53-4390-8218-a49b781ef2f9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57782025-01-13T22:50:56.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 89b26ec4-6f53-4390-8218-a49b781ef2f9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57792025-01-13T22:50:56.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 89b26ec4-6f53-4390-8218-a49b781ef2f9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57802025-01-13T22:50:57.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 902a6f6c-5f55-4c29-9809-f0934edb2d31 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57812025-01-13T22:50:57.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 902a6f6c-5f55-4c29-9809-f0934edb2d31 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57822025-01-13T22:50:57.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 902a6f6c-5f55-4c29-9809-f0934edb2d31 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57832025-01-13T22:50:58.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 285a88d3-1e1f-4880-aee4-1f6244973c3e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57842025-01-13T22:50:58.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 285a88d3-1e1f-4880-aee4-1f6244973c3e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57852025-01-13T22:50:58.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 285a88d3-1e1f-4880-aee4-1f6244973c3e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57862025-01-13T22:50:59.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e7fa38c0-77c7-4ca0-803b-a1a82bade666 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57872025-01-13T22:50:59.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e7fa38c0-77c7-4ca0-803b-a1a82bade666 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57882025-01-13T22:50:59.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e7fa38c0-77c7-4ca0-803b-a1a82bade666 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57892025-01-13T22:51:01.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84f367c0-d9bc-4bf3-b65a-7bb5ead64641 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57902025-01-13T22:51:01.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84f367c0-d9bc-4bf3-b65a-7bb5ead64641 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57912025-01-13T22:51:01.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84f367c0-d9bc-4bf3-b65a-7bb5ead64641 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
57922025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
57932025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
57942025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
57952025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57962025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57972025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57982025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
57992025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
58002025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58012025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
58022025-01-13T22:51:01.070ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58032025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58042025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58052025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
58062025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58072025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
58082025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58092025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
58102025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58112025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58122025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
58132025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
58142025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58152025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
58162025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
58172025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58182025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58192025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
58202025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58212025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
58222025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58232025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
58242025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
58252025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58262025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58272025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
58282025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58292025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58302025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58312025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58322025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58332025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58342025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58352025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58362025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58372025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58382025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58392025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58402025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58412025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58422025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58432025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58442025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58452025-01-13T22:51:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58462025-01-13T22:51:01.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472025-01-13T22:51:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.617144ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58482025-01-13T22:51:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.840201ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
58492025-01-13T22:51:01.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502025-01-13T22:51:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58512025-01-13T22:51:01.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58522025-01-13T22:51:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58532025-01-13T22:51:01.075ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58542025-01-13T22:51:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58552025-01-13T22:51:01.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58562025-01-13T22:51:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58572025-01-13T22:51:01.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58582025-01-13T22:51:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58592025-01-13T22:51:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58602025-01-13T22:51:01.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612025-01-13T22:51:01.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622025-01-13T22:51:01.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58632025-01-13T22:51:01.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58642025-01-13T22:51:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58652025-01-13T22:51:01.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3120, tv_nsec: 705311787 } })
58662025-01-13T22:51:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58672025-01-13T22:51:01.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58682025-01-13T22:51:01.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58692025-01-13T22:51:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58702025-01-13T22:51:01.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58712025-01-13T22:51:01.081ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58722025-01-13T22:51:01.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58732025-01-13T22:51:01.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3120, tv_nsec: 708235769 } })
58742025-01-13T22:51:01.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58752025-01-13T22:51:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58762025-01-13T22:51:01.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58772025-01-13T22:51:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58782025-01-13T22:51:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58792025-01-13T22:51:01.083ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58802025-01-13T22:51:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58812025-01-13T22:51:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58822025-01-13T22:51:01.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58832025-01-13T22:51:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58842025-01-13T22:51:01.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58852025-01-13T22:51:01.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.667663ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58862025-01-13T22:51:01.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.611801ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58872025-01-13T22:51:01.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58882025-01-13T22:51:01.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58892025-01-13T22:51:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58902025-01-13T22:51:01.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58912025-01-13T22:51:01.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58922025-01-13T22:51:01.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58932025-01-13T22:51:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58942025-01-13T22:51:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58952025-01-13T22:51:01.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58962025-01-13T22:51:01.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58972025-01-13T22:51:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58982025-01-13T22:51:01.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3120, tv_nsec: 714539287 } })
58992025-01-13T22:51:01.088ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
59002025-01-13T22:51:01.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012025-01-13T22:51:01.090ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59022025-01-13T22:51:01.090ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.764673ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59032025-01-13T22:51:01.090ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042025-01-13T22:51:01.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59052025-01-13T22:51:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59062025-01-13T22:51:01.093ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59072025-01-13T22:51:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59082025-01-13T22:51:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59092025-01-13T22:51:01.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59102025-01-13T22:51:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59112025-01-13T22:51:01.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
59122025-01-13T22:51:01.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59132025-01-13T22:51:01.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59142025-01-13T22:51:01.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59152025-01-13T22:51:01.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59162025-01-13T22:51:01.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
59172025-01-13T22:51:01.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.624378ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
59182025-01-13T22:51:01.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59192025-01-13T22:51:01.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59202025-01-13T22:51:01.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59212025-01-13T22:51:01.115ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59222025-01-13T22:51:01.115ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59232025-01-13T22:51:01.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59242025-01-13T22:51:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59252025-01-13T22:51:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
59262025-01-13T22:51:01.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59272025-01-13T22:51:01.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59282025-01-13T22:51:01.118ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59292025-01-13T22:51:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59302025-01-13T22:51:01.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59312025-01-13T22:51:01.119ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.822516ms iteration = 16 status = 0
59322025-01-13T22:51:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59332025-01-13T22:51:01.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59342025-01-13T22:51:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59352025-01-13T22:51:01.123ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
59362025-01-13T22:51:01.123ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 53.145081ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
59372025-01-13T22:51:01.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.164873ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
59382025-01-13T22:51:01.146ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59392025-01-13T22:51:01.146ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59402025-01-13T22:51:01.146ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59412025-01-13T22:51:01.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59422025-01-13T22:51:01.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.418016ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59432025-01-13T22:51:01.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.857319ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
59442025-01-13T22:51:01.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59452025-01-13T22:51:01.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59462025-01-13T22:51:01.184ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59472025-01-13T22:51:01.184ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59482025-01-13T22:51:01.184ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.053916ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59492025-01-13T22:51:01.189ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.012502ms iteration = 18 status = {"physical_disks_added":0}
59502025-01-13T22:51:01.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59512025-01-13T22:51:01.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59522025-01-13T22:51:01.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59532025-01-13T22:51:01.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59542025-01-13T22:51:01.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59552025-01-13T22:51:01.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59562025-01-13T22:51:01.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59572025-01-13T22:51:01.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59582025-01-13T22:51:01.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59592025-01-13T22:51:01.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59602025-01-13T22:51:01.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 611e7223-95fb-4c6a-869b-6d2e195400c0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59612025-01-13T22:51:01.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 611e7223-95fb-4c6a-869b-6d2e195400c0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59622025-01-13T22:51:01.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 611e7223-95fb-4c6a-869b-6d2e195400c0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59632025-01-13T22:51:01.243ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59642025-01-13T22:51:01.243ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59652025-01-13T22:51:01.243ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "566af35a-b519-44e3-b9c3-d2098080b04b", "content-length": "26", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
59662025-01-13T22:51:01.243ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59672025-01-13T22:51:01.245ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59682025-01-13T22:51:01.285ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59692025-01-13T22:51:01.285ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59702025-01-13T22:51:01.285ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9362f3e6-d4ef-4fcd-8587-9e73ee3ace17", "content-length": "26", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
59712025-01-13T22:51:01.285ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59722025-01-13T22:51:01.287ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59732025-01-13T22:51:01.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
59742025-01-13T22:51:01.309ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59752025-01-13T22:51:01.309ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f62473c4-ba10-4a46-a443-74d88e927738", "content-length": "26", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
59762025-01-13T22:51:01.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59772025-01-13T22:51:01.310ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
59782025-01-13T22:51:01.336ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59792025-01-13T22:51:01.336ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59802025-01-13T22:51:01.337ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c31ca52-2bf3-43a9-bcd8-220c42b5379d", "content-length": "372", "date": "Mon, 13 Jan 2025 22:51:01 GMT"} })
59812025-01-13T22:51:01.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59822025-01-13T22:51:01.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59832025-01-13T22:51:01.351ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
59842025-01-13T22:51:01.351ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59852025-01-13T22:51:01.351ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "791935dc-b53b-466a-ae1c-1dd191c724ff", "date": "Mon, 13 Jan 2025 22:51:01 GMT"} })
59862025-01-13T22:51:01.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59872025-01-13T22:51:01.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59882025-01-13T22:51:01.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59892025-01-13T22:51:01.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59902025-01-13T22:51:01.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59912025-01-13T22:51:01.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59922025-01-13T22:51:01.382ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.341022ms iteration = 16 status = {}
59932025-01-13T22:51:01.405ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59942025-01-13T22:51:01.405ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "653e3a97-48f9-4aaa-b116-b14b32abd3d2", "content-length": "1", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
59952025-01-13T22:51:01.407ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59962025-01-13T22:51:01.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59972025-01-13T22:51:01.414ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59982025-01-13T22:51:01.414ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ee76cce-052b-45dd-a724-21f61a4f9942", "content-length": "691", "date": "Mon, 13 Jan 2025 22:51:01 GMT"} })
59992025-01-13T22:51:01.414ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60002025-01-13T22:51:01.414ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60012025-01-13T22:51:01.414ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60022025-01-13T22:51:01.415ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 345.70814ms iteration = 16 status = {}
60032025-01-13T22:51:01.417ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.95965ms iteration = 16 status = null
60042025-01-13T22:51:01.417ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60052025-01-13T22:51:01.417ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60062025-01-13T22:51:01.418ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06912145-2c47-4e0f-9248-ac7a6586ee99", "date": "Mon, 13 Jan 2025 22:51:01 GMT"} })
60072025-01-13T22:51:01.420ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.077838ms iteration = 16 status = {}
60082025-01-13T22:51:01.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60092025-01-13T22:51:01.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60102025-01-13T22:51:01.489ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
60112025-01-13T22:51:01.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60122025-01-13T22:51:01.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60132025-01-13T22:51:01.499ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60142025-01-13T22:51:01.500ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "76f3564b-d661-4717-b548-1922e23f0381", "content-length": "134", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
60152025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60162025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
60172025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60182025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60192025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60202025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60212025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60222025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60232025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60242025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60252025-01-13T22:51:01.500ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
60262025-01-13T22:51:01.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60272025-01-13T22:51:01.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60282025-01-13T22:51:01.502ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60292025-01-13T22:51:01.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "00fc9ba2-27b3-47e1-8b48-389a64a9671f", "content-length": "2", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
60302025-01-13T22:51:01.502ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60312025-01-13T22:51:01.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "596025d4-94bf-42f5-b7cb-8dadf3791aa6", "content-length": "51", "date": "Mon, 13 Jan 2025 22:51:00 GMT"} })
60322025-01-13T22:51:01.503ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
60332025-01-13T22:51:01.503ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60342025-01-13T22:51:01.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "878fa28b-89f3-43fa-88cd-291c16a71939", "date": "Mon, 13 Jan 2025 22:51:01 GMT"} })
60352025-01-13T22:51:01.591ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
60362025-01-13T22:51:01.591ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60372025-01-13T22:51:01.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe7786ea-e363-402c-b9c5-7d94cfd92135", "content-length": "682", "date": "Mon, 13 Jan 2025 22:51:01 GMT"} })
60382025-01-13T22:51:01.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60392025-01-13T22:51:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60402025-01-13T22:51:01.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60412025-01-13T22:51:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60422025-01-13T22:51:01.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60432025-01-13T22:51:01.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60442025-01-13T22:51:01.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60452025-01-13T22:51:01.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60462025-01-13T22:51:01.607ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 536.78082ms iteration = 16 status = {}
60472025-01-13T22:51:02.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72d53480-7b66-43cb-88f7-bda847dc0327 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60482025-01-13T22:51:02.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72d53480-7b66-43cb-88f7-bda847dc0327 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60492025-01-13T22:51:02.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72d53480-7b66-43cb-88f7-bda847dc0327 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60502025-01-13T22:51:03.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a16b518-747a-4adb-b415-451d3fa50ce1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60512025-01-13T22:51:03.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a16b518-747a-4adb-b415-451d3fa50ce1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60522025-01-13T22:51:03.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0a16b518-747a-4adb-b415-451d3fa50ce1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60532025-01-13T22:51:03.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 3f3b6d68-b19c-47f3-9618-8b0b703d41d9 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
60542025-01-13T22:51:04.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1cb364-f7be-4d13-a8c2-652b4d849cb6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60552025-01-13T22:51:04.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1cb364-f7be-4d13-a8c2-652b4d849cb6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60562025-01-13T22:51:04.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d1cb364-f7be-4d13-a8c2-652b4d849cb6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60572025-01-13T22:51:05.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c17fdad7-4511-42f9-93e6-09840268ce00 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60582025-01-13T22:51:05.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c17fdad7-4511-42f9-93e6-09840268ce00 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60592025-01-13T22:51:05.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c17fdad7-4511-42f9-93e6-09840268ce00 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60602025-01-13T22:51:06.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ccaf6cd-c360-4a9c-8ff1-9aa8a4879c04 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60612025-01-13T22:51:06.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ccaf6cd-c360-4a9c-8ff1-9aa8a4879c04 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60622025-01-13T22:51:06.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ccaf6cd-c360-4a9c-8ff1-9aa8a4879c04 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60632025-01-13T22:51:07.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 699601fc-690b-49ee-abf3-ef3364818ae0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60642025-01-13T22:51:07.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 699601fc-690b-49ee-abf3-ef3364818ae0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60652025-01-13T22:51:07.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 699601fc-690b-49ee-abf3-ef3364818ae0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60662025-01-13T22:51:08.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 822bf218-befc-427a-b3db-9860d3804a6d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60672025-01-13T22:51:08.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 822bf218-befc-427a-b3db-9860d3804a6d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60682025-01-13T22:51:08.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 822bf218-befc-427a-b3db-9860d3804a6d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60692025-01-13T22:51:09.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = be87d5d5-f03f-4a65-ad3d-79e245948f5e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60702025-01-13T22:51:09.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = be87d5d5-f03f-4a65-ad3d-79e245948f5e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60712025-01-13T22:51:09.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = be87d5d5-f03f-4a65-ad3d-79e245948f5e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60722025-01-13T22:51:10.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f94ee35b-8294-44cc-92e7-6d1cb6339b7f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60732025-01-13T22:51:10.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f94ee35b-8294-44cc-92e7-6d1cb6339b7f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60742025-01-13T22:51:10.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f94ee35b-8294-44cc-92e7-6d1cb6339b7f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60752025-01-13T22:51:11.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
60762025-01-13T22:51:11.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
60772025-01-13T22:51:11.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60782025-01-13T22:51:11.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60792025-01-13T22:51:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60802025-01-13T22:51:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60812025-01-13T22:51:11.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60822025-01-13T22:51:11.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60832025-01-13T22:51:11.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.924334ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60842025-01-13T22:51:11.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60852025-01-13T22:51:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60862025-01-13T22:51:11.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60872025-01-13T22:51:11.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60882025-01-13T22:51:11.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60892025-01-13T22:51:11.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60902025-01-13T22:51:11.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60912025-01-13T22:51:11.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
60922025-01-13T22:51:11.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60932025-01-13T22:51:11.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60942025-01-13T22:51:11.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
60952025-01-13T22:51:11.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.831412ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
60962025-01-13T22:51:11.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 06835d5b-721c-4538-a455-c910b585fa22 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60972025-01-13T22:51:11.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 06835d5b-721c-4538-a455-c910b585fa22 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60982025-01-13T22:51:11.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 06835d5b-721c-4538-a455-c910b585fa22 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
60992025-01-13T22:51:12.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 175efa25-642d-4ef3-ae1d-853d59fcca99 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61002025-01-13T22:51:12.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 175efa25-642d-4ef3-ae1d-853d59fcca99 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61012025-01-13T22:51:12.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 175efa25-642d-4ef3-ae1d-853d59fcca99 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61022025-01-13T22:51:13.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43ff961c-2d3b-4ae0-949a-1f7a265afca6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61032025-01-13T22:51:13.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43ff961c-2d3b-4ae0-949a-1f7a265afca6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61042025-01-13T22:51:13.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43ff961c-2d3b-4ae0-949a-1f7a265afca6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61052025-01-13T22:51:13.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 023e6974-03d2-4224-bce5-bf1aa9c8388b response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
61062025-01-13T22:51:14.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0156e9d7-6455-46ee-922b-af1ab86fd35a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61072025-01-13T22:51:14.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0156e9d7-6455-46ee-922b-af1ab86fd35a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61082025-01-13T22:51:14.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0156e9d7-6455-46ee-922b-af1ab86fd35a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61092025-01-13T22:51:15.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 202a7d8d-c514-4048-afcd-c72c6fb30a16 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61102025-01-13T22:51:15.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 202a7d8d-c514-4048-afcd-c72c6fb30a16 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61112025-01-13T22:51:15.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 202a7d8d-c514-4048-afcd-c72c6fb30a16 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61122025-01-13T22:51:16.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 289dc2ed-7bac-4ccc-a89a-1bfd76f991db roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61132025-01-13T22:51:16.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 289dc2ed-7bac-4ccc-a89a-1bfd76f991db resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61142025-01-13T22:51:16.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 289dc2ed-7bac-4ccc-a89a-1bfd76f991db response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61152025-01-13T22:51:17.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ef7d98c3-aa32-4019-8709-997b31cb587e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61162025-01-13T22:51:17.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ef7d98c3-aa32-4019-8709-997b31cb587e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61172025-01-13T22:51:17.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ef7d98c3-aa32-4019-8709-997b31cb587e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61182025-01-13T22:51:18.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2fb22806-ca55-478d-b8f4-18cce910434f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61192025-01-13T22:51:18.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2fb22806-ca55-478d-b8f4-18cce910434f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61202025-01-13T22:51:18.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2fb22806-ca55-478d-b8f4-18cce910434f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61212025-01-13T22:51:19.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 18c077f4-7dcc-4db9-b168-6c114328e674 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61222025-01-13T22:51:19.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 18c077f4-7dcc-4db9-b168-6c114328e674 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61232025-01-13T22:51:19.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 18c077f4-7dcc-4db9-b168-6c114328e674 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61242025-01-13T22:51:20.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8edac8ea-ab30-4c61-9dde-1dc8e7557ad4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61252025-01-13T22:51:20.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8edac8ea-ab30-4c61-9dde-1dc8e7557ad4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61262025-01-13T22:51:20.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8edac8ea-ab30-4c61-9dde-1dc8e7557ad4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61272025-01-13T22:51:21.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
61282025-01-13T22:51:21.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61292025-01-13T22:51:21.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
61302025-01-13T22:51:21.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61312025-01-13T22:51:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61322025-01-13T22:51:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61332025-01-13T22:51:21.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342025-01-13T22:51:21.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61352025-01-13T22:51:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61362025-01-13T22:51:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61372025-01-13T22:51:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61382025-01-13T22:51:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61392025-01-13T22:51:21.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.796981ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61402025-01-13T22:51:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61412025-01-13T22:51:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61422025-01-13T22:51:21.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61432025-01-13T22:51:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
61442025-01-13T22:51:21.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61452025-01-13T22:51:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61462025-01-13T22:51:21.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
61472025-01-13T22:51:21.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.492708ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
61482025-01-13T22:51:21.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7629347b-557b-4a7b-8aca-4710579cdd17 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61492025-01-13T22:51:21.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7629347b-557b-4a7b-8aca-4710579cdd17 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61502025-01-13T22:51:21.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7629347b-557b-4a7b-8aca-4710579cdd17 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61512025-01-13T22:51:22.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 531d6646-6774-4fce-bc38-c0cd8b112f83 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61522025-01-13T22:51:22.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 531d6646-6774-4fce-bc38-c0cd8b112f83 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61532025-01-13T22:51:22.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 531d6646-6774-4fce-bc38-c0cd8b112f83 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61542025-01-13T22:51:23.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7ece46d5-444b-4e31-9aab-cf1eb3dfcce9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61552025-01-13T22:51:23.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7ece46d5-444b-4e31-9aab-cf1eb3dfcce9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61562025-01-13T22:51:23.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7ece46d5-444b-4e31-9aab-cf1eb3dfcce9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61572025-01-13T22:51:23.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 473 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = f726adce-c892-4810-960f-960efa04adda response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
61582025-01-13T22:51:24.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53133b9c-1d21-4c11-8f5f-4a564f430535 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61592025-01-13T22:51:24.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53133b9c-1d21-4c11-8f5f-4a564f430535 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61602025-01-13T22:51:24.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53133b9c-1d21-4c11-8f5f-4a564f430535 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61612025-01-13T22:51:25.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa595b78-d36c-4b7b-9d3c-9bc0416474a4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61622025-01-13T22:51:25.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa595b78-d36c-4b7b-9d3c-9bc0416474a4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61632025-01-13T22:51:25.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa595b78-d36c-4b7b-9d3c-9bc0416474a4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61642025-01-13T22:51:26.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ccba9cd0-74b1-4ac4-99e1-486ca834659b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61652025-01-13T22:51:26.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ccba9cd0-74b1-4ac4-99e1-486ca834659b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61662025-01-13T22:51:26.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ccba9cd0-74b1-4ac4-99e1-486ca834659b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61672025-01-13T22:51:27.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 092b7895-77fb-432c-bfde-90492a76ccde roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61682025-01-13T22:51:27.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 092b7895-77fb-432c-bfde-90492a76ccde resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61692025-01-13T22:51:27.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 092b7895-77fb-432c-bfde-90492a76ccde response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61702025-01-13T22:51:28.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e1402f7-411d-4a49-a7d1-a5d642aa7472 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61712025-01-13T22:51:28.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e1402f7-411d-4a49-a7d1-a5d642aa7472 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61722025-01-13T22:51:28.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e1402f7-411d-4a49-a7d1-a5d642aa7472 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61732025-01-13T22:51:29.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1633b7d6-d1bf-45f9-b586-61d997afe03b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61742025-01-13T22:51:29.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1633b7d6-d1bf-45f9-b586-61d997afe03b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61752025-01-13T22:51:29.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1633b7d6-d1bf-45f9-b586-61d997afe03b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61762025-01-13T22:51:30.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6a9344e4-105a-49a7-b34c-57128a4a8b9c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61772025-01-13T22:51:30.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6a9344e4-105a-49a7-b34c-57128a4a8b9c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61782025-01-13T22:51:30.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6a9344e4-105a-49a7-b34c-57128a4a8b9c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
61792025-01-13T22:51:31.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
61802025-01-13T22:51:31.068ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
61812025-01-13T22:51:31.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
61822025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61832025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61842025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61852025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
61862025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61872025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61882025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
61892025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
61902025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
61912025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
61922025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61932025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61942025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
61952025-01-13T22:51:31.069ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
61962025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.601\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
61972025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
61982025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
61992025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62002025-01-13T22:51:31.069ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62012025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
62022025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62032025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
62042025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
62052025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62062025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62072025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
62082025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62092025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62102025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
62112025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
62122025-01-13T22:51:31.069ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62132025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62142025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62152025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
62162025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62172025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
62182025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
62192025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62202025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62212025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
62222025-01-13T22:51:31.069ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:41:31.069209223 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
62232025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
62242025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
62252025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62262025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
62272025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62282025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
62292025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62302025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
62312025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62322025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
62332025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62342025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
62352025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62362025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
62372025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62382025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
62392025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
62402025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
62412025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62422025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62432025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62442025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62452025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62462025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62472025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62482025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62492025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62502025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62512025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62522025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62532025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62542025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62552025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62562025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62572025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62582025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62592025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62602025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62612025-01-13T22:51:31.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3150, tv_nsec: 696146029 } })
62622025-01-13T22:51:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62632025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62642025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62652025-01-13T22:51:31.070ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3150, tv_nsec: 696189490 } })
62662025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62672025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62682025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62692025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62702025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
62712025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.360553ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
62722025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
62732025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.515918ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
62742025-01-13T22:51:31.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62752025-01-13T22:51:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62762025-01-13T22:51:31.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62772025-01-13T22:51:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62782025-01-13T22:51:31.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792025-01-13T22:51:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.169491ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62802025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62812025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62822025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62832025-01-13T22:51:31.074ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62842025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62852025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62862025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62872025-01-13T22:51:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62882025-01-13T22:51:31.075ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62892025-01-13T22:51:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62902025-01-13T22:51:31.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62912025-01-13T22:51:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62922025-01-13T22:51:31.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62932025-01-13T22:51:31.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62942025-01-13T22:51:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62952025-01-13T22:51:31.077ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62962025-01-13T22:51:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62972025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62982025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62992025-01-13T22:51:31.079ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:41:31.069209223 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63002025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.043226ms iteration = 9 status = {"expiration":"2025-01-13T22:41:31.069209223Z","pruned":[]}
63012025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63022025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63032025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63042025-01-13T22:51:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63052025-01-13T22:51:31.080ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63062025-01-13T22:51:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63072025-01-13T22:51:31.081ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.537164ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
63082025-01-13T22:51:31.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092025-01-13T22:51:31.082ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102025-01-13T22:51:31.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3150, tv_nsec: 709764477 } })
63112025-01-13T22:51:31.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3150, tv_nsec: 709915312 } })
63122025-01-13T22:51:31.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
63132025-01-13T22:51:31.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
63142025-01-13T22:51:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63152025-01-13T22:51:31.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63162025-01-13T22:51:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63172025-01-13T22:51:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
63182025-01-13T22:51:31.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63192025-01-13T22:51:31.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63202025-01-13T22:51:31.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63212025-01-13T22:51:31.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222025-01-13T22:51:31.092ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63232025-01-13T22:51:31.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63242025-01-13T22:51:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63252025-01-13T22:51:31.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63262025-01-13T22:51:31.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3150, tv_nsec: 722573430 } })
63272025-01-13T22:51:31.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
63282025-01-13T22:51:31.096ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63292025-01-13T22:51:31.096ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63302025-01-13T22:51:31.096ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63312025-01-13T22:51:31.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63322025-01-13T22:51:31.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63332025-01-13T22:51:31.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63342025-01-13T22:51:31.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63352025-01-13T22:51:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63362025-01-13T22:51:31.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63372025-01-13T22:51:31.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63382025-01-13T22:51:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63392025-01-13T22:51:31.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63402025-01-13T22:51:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63412025-01-13T22:51:31.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422025-01-13T22:51:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63432025-01-13T22:51:31.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63442025-01-13T22:51:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63452025-01-13T22:51:31.109ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462025-01-13T22:51:31.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63472025-01-13T22:51:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
63482025-01-13T22:51:31.113ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63492025-01-13T22:51:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63502025-01-13T22:51:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63512025-01-13T22:51:31.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63522025-01-13T22:51:31.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63532025-01-13T22:51:31.121ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63542025-01-13T22:51:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63552025-01-13T22:51:31.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.253315ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
63562025-01-13T22:51:31.124ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63572025-01-13T22:51:31.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63582025-01-13T22:51:31.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.997033ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
63592025-01-13T22:51:31.129ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63602025-01-13T22:51:31.129ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63612025-01-13T22:51:31.129ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.491803ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63622025-01-13T22:51:31.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632025-01-13T22:51:31.135ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63642025-01-13T22:51:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63652025-01-13T22:51:31.137ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63662025-01-13T22:51:31.137ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63672025-01-13T22:51:31.137ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63682025-01-13T22:51:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63692025-01-13T22:51:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63702025-01-13T22:51:31.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63712025-01-13T22:51:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63722025-01-13T22:51:31.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63732025-01-13T22:51:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63742025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63752025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63762025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63772025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63782025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63792025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63802025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63812025-01-13T22:51:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63822025-01-13T22:51:31.143ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63832025-01-13T22:51:31.143ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63842025-01-13T22:51:31.143ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.118851ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63852025-01-13T22:51:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63862025-01-13T22:51:31.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63872025-01-13T22:51:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63882025-01-13T22:51:31.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63892025-01-13T22:51:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63902025-01-13T22:51:31.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63912025-01-13T22:51:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63922025-01-13T22:51:31.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.780405ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63932025-01-13T22:51:31.157ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63942025-01-13T22:51:31.157ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.832953ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63952025-01-13T22:51:31.163ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
63962025-01-13T22:51:31.163ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 93.923194ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
63972025-01-13T22:51:31.165ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.577177ms iteration = 19 status = {"physical_disks_added":0}
63982025-01-13T22:51:31.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63992025-01-13T22:51:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64002025-01-13T22:51:31.198ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64012025-01-13T22:51:31.247ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64022025-01-13T22:51:31.247ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64032025-01-13T22:51:31.247ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a5ac248-da29-4774-82b5-b046c0c228a0", "content-length": "26", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
64042025-01-13T22:51:31.247ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64052025-01-13T22:51:31.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64062025-01-13T22:51:31.267ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64072025-01-13T22:51:31.267ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64082025-01-13T22:51:31.267ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "40424006-1ed0-4e17-988d-d91f7bc12a6a", "content-length": "372", "date": "Mon, 13 Jan 2025 22:51:31 GMT"} })
64092025-01-13T22:51:31.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64102025-01-13T22:51:31.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64112025-01-13T22:51:31.269ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64122025-01-13T22:51:31.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64132025-01-13T22:51:31.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64142025-01-13T22:51:31.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64152025-01-13T22:51:31.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64162025-01-13T22:51:31.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64172025-01-13T22:51:31.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182025-01-13T22:51:31.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64192025-01-13T22:51:31.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64202025-01-13T22:51:31.274ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64212025-01-13T22:51:31.274ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
64222025-01-13T22:51:31.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64232025-01-13T22:51:31.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64242025-01-13T22:51:31.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 5c4f743f-faf4-4616-b1d1-43d4993c9794 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64252025-01-13T22:51:31.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 5c4f743f-faf4-4616-b1d1-43d4993c9794 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64262025-01-13T22:51:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64272025-01-13T22:51:31.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64282025-01-13T22:51:31.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64292025-01-13T22:51:31.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 5c4f743f-faf4-4616-b1d1-43d4993c9794 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64302025-01-13T22:51:31.293ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64312025-01-13T22:51:31.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
64322025-01-13T22:51:31.303ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64332025-01-13T22:51:31.304ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "026c2fb7-6511-4798-83cc-c2a8bb1c0711", "content-length": "26", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
64342025-01-13T22:51:31.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64352025-01-13T22:51:31.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
64362025-01-13T22:51:31.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64372025-01-13T22:51:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64382025-01-13T22:51:31.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 238.010305ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64392025-01-13T22:51:31.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64402025-01-13T22:51:31.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 238.595563ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64412025-01-13T22:51:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64422025-01-13T22:51:31.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64432025-01-13T22:51:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64442025-01-13T22:51:31.309ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64452025-01-13T22:51:31.309ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64462025-01-13T22:51:31.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 240.484492ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64472025-01-13T22:51:31.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64482025-01-13T22:51:31.315ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64492025-01-13T22:51:31.315ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64502025-01-13T22:51:31.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64512025-01-13T22:51:31.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64522025-01-13T22:51:31.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64532025-01-13T22:51:31.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64542025-01-13T22:51:31.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64552025-01-13T22:51:31.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64562025-01-13T22:51:31.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64572025-01-13T22:51:31.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
64582025-01-13T22:51:31.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64592025-01-13T22:51:31.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64602025-01-13T22:51:31.322ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64612025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64622025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
64632025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 253.386828ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64642025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
64652025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64662025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
64672025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 253.545212ms iteration = 9 status = {"generation":2}
64682025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "028a6f60-6dc6-4cce-b06d-571c79486487", "date": "Mon, 13 Jan 2025 22:51:31 GMT"} })
64692025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64702025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64712025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64722025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64732025-01-13T22:51:31.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64742025-01-13T22:51:31.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64752025-01-13T22:51:31.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64762025-01-13T22:51:31.325ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64772025-01-13T22:51:31.325ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64782025-01-13T22:51:31.325ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
64792025-01-13T22:51:31.325ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 256.715353ms iteration = 9 status = {"generation":1}
64802025-01-13T22:51:31.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64812025-01-13T22:51:31.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64822025-01-13T22:51:31.331ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64832025-01-13T22:51:31.331ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64842025-01-13T22:51:31.331ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fa34fae0-0c14-4917-981d-6e099d9dc236", "date": "Mon, 13 Jan 2025 22:51:31 GMT"} })
64852025-01-13T22:51:31.333ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 264.57855ms iteration = 17 status = {}
64862025-01-13T22:51:31.334ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
64872025-01-13T22:51:31.334ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 264.865069ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
64882025-01-13T22:51:31.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 266.663275ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
64892025-01-13T22:51:31.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902025-01-13T22:51:31.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
64912025-01-13T22:51:31.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64922025-01-13T22:51:31.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64932025-01-13T22:51:31.349ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 280.037726ms iteration = 17 status = 0
64942025-01-13T22:51:31.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64952025-01-13T22:51:31.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dbb12879-0206-4895-9a0c-c39d56427c35", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64962025-01-13T22:51:31.377ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64972025-01-13T22:51:31.377ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64982025-01-13T22:51:31.377ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 308.621695ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64992025-01-13T22:51:31.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d7e36752-c198-4461-890d-2add336325bb", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65002025-01-13T22:51:31.379ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65012025-01-13T22:51:31.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65022025-01-13T22:51:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65032025-01-13T22:51:31.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65042025-01-13T22:51:31.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 311.858997ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
65052025-01-13T22:51:31.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65062025-01-13T22:51:31.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65072025-01-13T22:51:31.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65082025-01-13T22:51:31.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65092025-01-13T22:51:31.397ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65102025-01-13T22:51:31.397ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65112025-01-13T22:51:31.397ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eabddf06-f74d-43df-8a02-cba342d4b761", "content-length": "26", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
65122025-01-13T22:51:31.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65132025-01-13T22:51:31.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65142025-01-13T22:51:31.409ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 340.688133ms iteration = 17 status = {}
65152025-01-13T22:51:31.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162025-01-13T22:51:31.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65172025-01-13T22:51:31.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65182025-01-13T22:51:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65192025-01-13T22:51:31.432ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65202025-01-13T22:51:31.451ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65212025-01-13T22:51:31.451ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ead53b-c422-432e-8c83-a5bbeef9d4c8", "content-length": "1", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
65222025-01-13T22:51:31.453ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65232025-01-13T22:51:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65242025-01-13T22:51:31.456ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 386.973319ms iteration = 17 status = null
65252025-01-13T22:51:31.474ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
65262025-01-13T22:51:31.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a9305b74-e26a-4ee1-be9c-880308f861ff", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65272025-01-13T22:51:31.475ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65282025-01-13T22:51:31.476ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1787d16d-b84e-427d-96e3-a17be5acc29e", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65292025-01-13T22:51:31.476ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65302025-01-13T22:51:31.477ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "996e540c-c169-4714-a953-3c21cf1c3aee", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65312025-01-13T22:51:31.477ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65322025-01-13T22:51:31.479ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65332025-01-13T22:51:31.479ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 410.5421ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65342025-01-13T22:51:31.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65352025-01-13T22:51:31.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65362025-01-13T22:51:31.518ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
65372025-01-13T22:51:31.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65382025-01-13T22:51:31.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65392025-01-13T22:51:31.527ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65402025-01-13T22:51:31.528ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "179c05e9-1130-4fa3-9ad7-079419b21dc9", "content-length": "691", "date": "Mon, 13 Jan 2025 22:51:31 GMT"} })
65412025-01-13T22:51:31.528ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65422025-01-13T22:51:31.528ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65432025-01-13T22:51:31.528ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65442025-01-13T22:51:31.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65452025-01-13T22:51:31.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "93590dc2-82e2-48ae-9951-81cd381199c3", "content-length": "134", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
65462025-01-13T22:51:31.528ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65472025-01-13T22:51:31.528ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
65482025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65492025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65502025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65512025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65522025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65532025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65542025-01-13T22:51:31.529ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.957334ms iteration = 17 status = {}
65552025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65562025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65572025-01-13T22:51:31.529ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
65582025-01-13T22:51:31.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65592025-01-13T22:51:31.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65602025-01-13T22:51:31.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65612025-01-13T22:51:31.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b482ed41-87b8-441c-8a9d-3b0894584626", "content-length": "2", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
65622025-01-13T22:51:31.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65632025-01-13T22:51:31.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "882d7f69-169c-448b-b337-3c97844a77ae", "content-length": "51", "date": "Mon, 13 Jan 2025 22:51:30 GMT"} })
65642025-01-13T22:51:31.531ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
65652025-01-13T22:51:31.531ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65662025-01-13T22:51:31.626ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5daf464a-d617-4600-af3c-423cc761f785", "date": "Mon, 13 Jan 2025 22:51:31 GMT"} })
65672025-01-13T22:51:31.626ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
65682025-01-13T22:51:31.626ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65692025-01-13T22:51:31.626ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "88e42740-e6f2-407a-82e8-bb9e20c4f7de", "content-length": "682", "date": "Mon, 13 Jan 2025 22:51:31 GMT"} })
65702025-01-13T22:51:31.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65712025-01-13T22:51:31.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65722025-01-13T22:51:31.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65732025-01-13T22:51:31.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65742025-01-13T22:51:31.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65752025-01-13T22:51:31.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65762025-01-13T22:51:31.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65772025-01-13T22:51:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65782025-01-13T22:51:31.642ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 573.624878ms iteration = 17 status = {}
65792025-01-13T22:51:31.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d89e8697-48ee-40c1-8b94-266991220abb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65802025-01-13T22:51:31.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d89e8697-48ee-40c1-8b94-266991220abb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65812025-01-13T22:51:31.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d89e8697-48ee-40c1-8b94-266991220abb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65822025-01-13T22:51:32.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba9d27ba-9b02-4c7e-925b-06acb220ae73 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65832025-01-13T22:51:32.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba9d27ba-9b02-4c7e-925b-06acb220ae73 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65842025-01-13T22:51:32.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba9d27ba-9b02-4c7e-925b-06acb220ae73 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65852025-01-13T22:51:33.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 9e777aab-cf34-48cf-8fec-8dbe2cbc845b response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
65862025-01-13T22:51:33.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 788b17a0-49a4-4868-aeba-217c19b7e70d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65872025-01-13T22:51:33.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 788b17a0-49a4-4868-aeba-217c19b7e70d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65882025-01-13T22:51:33.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 788b17a0-49a4-4868-aeba-217c19b7e70d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65892025-01-13T22:51:34.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f072ea34-db96-4f81-81aa-b743ed9a01aa roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65902025-01-13T22:51:34.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f072ea34-db96-4f81-81aa-b743ed9a01aa resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65912025-01-13T22:51:34.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f072ea34-db96-4f81-81aa-b743ed9a01aa response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65922025-01-13T22:51:35.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e74a31a5-18a1-47c3-89df-c95a1be3694a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65932025-01-13T22:51:35.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e74a31a5-18a1-47c3-89df-c95a1be3694a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65942025-01-13T22:51:35.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e74a31a5-18a1-47c3-89df-c95a1be3694a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65952025-01-13T22:51:36.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 13067485-fa2f-4625-aee3-1f6202c2312d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65962025-01-13T22:51:36.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 13067485-fa2f-4625-aee3-1f6202c2312d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65972025-01-13T22:51:36.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 13067485-fa2f-4625-aee3-1f6202c2312d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65982025-01-13T22:51:37.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d1ce867f-974f-4b16-8118-3601c1e1c908 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
65992025-01-13T22:51:37.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d1ce867f-974f-4b16-8118-3601c1e1c908 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66002025-01-13T22:51:37.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d1ce867f-974f-4b16-8118-3601c1e1c908 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66012025-01-13T22:51:38.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e59bf018-259b-4066-a065-0fbb8834b44d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66022025-01-13T22:51:38.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e59bf018-259b-4066-a065-0fbb8834b44d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66032025-01-13T22:51:38.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e59bf018-259b-4066-a065-0fbb8834b44d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66042025-01-13T22:51:39.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e3248ae3-b3f2-4155-b7d8-0e3b098fc252 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66052025-01-13T22:51:39.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e3248ae3-b3f2-4155-b7d8-0e3b098fc252 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66062025-01-13T22:51:39.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e3248ae3-b3f2-4155-b7d8-0e3b098fc252 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66072025-01-13T22:51:40.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e0169fd-4c5a-4dbf-bff9-3c606a90bc30 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66082025-01-13T22:51:40.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e0169fd-4c5a-4dbf-bff9-3c606a90bc30 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66092025-01-13T22:51:40.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e0169fd-4c5a-4dbf-bff9-3c606a90bc30 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66102025-01-13T22:51:41.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
66112025-01-13T22:51:41.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
66122025-01-13T22:51:41.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66132025-01-13T22:51:41.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66142025-01-13T22:51:41.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66152025-01-13T22:51:41.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66162025-01-13T22:51:41.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172025-01-13T22:51:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66182025-01-13T22:51:41.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66192025-01-13T22:51:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66202025-01-13T22:51:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66212025-01-13T22:51:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66222025-01-13T22:51:41.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66232025-01-13T22:51:41.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
66242025-01-13T22:51:41.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66252025-01-13T22:51:41.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66262025-01-13T22:51:41.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
66272025-01-13T22:51:41.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.895012ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
66282025-01-13T22:51:41.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66292025-01-13T22:51:41.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66302025-01-13T22:51:41.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.158297ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66312025-01-13T22:51:41.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53bba1c4-5e4c-4bec-934f-032337232243 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66322025-01-13T22:51:41.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53bba1c4-5e4c-4bec-934f-032337232243 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66332025-01-13T22:51:41.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53bba1c4-5e4c-4bec-934f-032337232243 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66342025-01-13T22:51:42.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 188d01ff-3479-45d7-b6bd-af460ca37371 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66352025-01-13T22:51:42.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 188d01ff-3479-45d7-b6bd-af460ca37371 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66362025-01-13T22:51:42.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 188d01ff-3479-45d7-b6bd-af460ca37371 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66372025-01-13T22:51:43.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 6827374a-5069-4df6-8f4a-d883e7c240ef roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
66382025-01-13T22:51:43.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 6827374a-5069-4df6-8f4a-d883e7c240ef resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
66392025-01-13T22:51:43.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 6827374a-5069-4df6-8f4a-d883e7c240ef response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
66402025-01-13T22:51:43.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 2c8693e5-09af-4663-9d14-49a4525b9c13 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
66412025-01-13T22:51:43.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 2c8693e5-09af-4663-9d14-49a4525b9c13 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
66422025-01-13T22:51:43.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 2c8693e5-09af-4663-9d14-49a4525b9c13 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
66432025-01-13T22:51:43.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = ce6514e9-d631-4e71-9d01-dd266e0eb93e response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
66442025-01-13T22:51:43.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5bc7660e-1f40-470c-a8b1-805258f39c2e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66452025-01-13T22:51:43.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5bc7660e-1f40-470c-a8b1-805258f39c2e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66462025-01-13T22:51:43.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5bc7660e-1f40-470c-a8b1-805258f39c2e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66472025-01-13T22:51:44.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a4e284c-c8ac-4dd5-83a8-89825e5817fe roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66482025-01-13T22:51:44.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a4e284c-c8ac-4dd5-83a8-89825e5817fe resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66492025-01-13T22:51:44.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a4e284c-c8ac-4dd5-83a8-89825e5817fe response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66502025-01-13T22:51:45.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c57e48d4-1874-42d4-848c-0a9112f71041 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66512025-01-13T22:51:45.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c57e48d4-1874-42d4-848c-0a9112f71041 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66522025-01-13T22:51:45.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c57e48d4-1874-42d4-848c-0a9112f71041 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66532025-01-13T22:51:46.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72612503-731b-4f43-ad62-55c062c01fd6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66542025-01-13T22:51:46.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72612503-731b-4f43-ad62-55c062c01fd6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66552025-01-13T22:51:46.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72612503-731b-4f43-ad62-55c062c01fd6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66562025-01-13T22:51:47.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d7883246-f644-453d-8e68-7402dd413f5d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66572025-01-13T22:51:47.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d7883246-f644-453d-8e68-7402dd413f5d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66582025-01-13T22:51:47.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d7883246-f644-453d-8e68-7402dd413f5d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66592025-01-13T22:51:49.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7944ce07-84ab-4d01-a55b-e00c801c631d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66602025-01-13T22:51:49.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7944ce07-84ab-4d01-a55b-e00c801c631d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66612025-01-13T22:51:49.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7944ce07-84ab-4d01-a55b-e00c801c631d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66622025-01-13T22:51:50.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f264d73-4d01-4fa6-8535-87f735171680 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66632025-01-13T22:51:50.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f264d73-4d01-4fa6-8535-87f735171680 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66642025-01-13T22:51:50.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f264d73-4d01-4fa6-8535-87f735171680 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66652025-01-13T22:51:51.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1a703a26-53cc-49d3-9703-a2da6d3a9443 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66662025-01-13T22:51:51.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1a703a26-53cc-49d3-9703-a2da6d3a9443 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66672025-01-13T22:51:51.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1a703a26-53cc-49d3-9703-a2da6d3a9443 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66682025-01-13T22:51:51.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
66692025-01-13T22:51:51.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
66702025-01-13T22:51:51.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66712025-01-13T22:51:51.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66722025-01-13T22:51:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66732025-01-13T22:51:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66742025-01-13T22:51:51.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66752025-01-13T22:51:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66762025-01-13T22:51:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66772025-01-13T22:51:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66782025-01-13T22:51:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66792025-01-13T22:51:51.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66802025-01-13T22:51:51.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66812025-01-13T22:51:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
66822025-01-13T22:51:51.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66832025-01-13T22:51:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66842025-01-13T22:51:51.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
66852025-01-13T22:51:51.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.57314ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
66862025-01-13T22:51:51.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66872025-01-13T22:51:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66882025-01-13T22:51:51.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.572575ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66892025-01-13T22:51:52.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce1eed3d-e654-43ed-8ba7-2068467c44a9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66902025-01-13T22:51:52.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce1eed3d-e654-43ed-8ba7-2068467c44a9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66912025-01-13T22:51:52.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ce1eed3d-e654-43ed-8ba7-2068467c44a9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66922025-01-13T22:51:53.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eb5072eb-e959-4649-b606-571890b3bc19 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66932025-01-13T22:51:53.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eb5072eb-e959-4649-b606-571890b3bc19 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66942025-01-13T22:51:53.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eb5072eb-e959-4649-b606-571890b3bc19 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66952025-01-13T22:51:53.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = dbb97c67-5e9c-4e75-bb16-4431aa401f2d response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
66962025-01-13T22:51:54.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9c127243-1cbd-4c3e-a7e5-750238f6e785 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66972025-01-13T22:51:54.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9c127243-1cbd-4c3e-a7e5-750238f6e785 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66982025-01-13T22:51:54.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9c127243-1cbd-4c3e-a7e5-750238f6e785 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
66992025-01-13T22:51:55.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53f6b137-9ae3-4851-bd9d-424f425053e9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67002025-01-13T22:51:55.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53f6b137-9ae3-4851-bd9d-424f425053e9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67012025-01-13T22:51:55.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53f6b137-9ae3-4851-bd9d-424f425053e9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67022025-01-13T22:51:56.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3a81d67-5aed-45db-a9a9-39af951920d5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67032025-01-13T22:51:56.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3a81d67-5aed-45db-a9a9-39af951920d5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67042025-01-13T22:51:56.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3a81d67-5aed-45db-a9a9-39af951920d5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67052025-01-13T22:51:57.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f5f5ed5b-dc90-407c-b542-72069eb54260 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67062025-01-13T22:51:57.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f5f5ed5b-dc90-407c-b542-72069eb54260 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67072025-01-13T22:51:57.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f5f5ed5b-dc90-407c-b542-72069eb54260 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67082025-01-13T22:51:58.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6c6347a0-0b23-45d4-9a94-b2dae72809fe roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67092025-01-13T22:51:58.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6c6347a0-0b23-45d4-9a94-b2dae72809fe resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67102025-01-13T22:51:58.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6c6347a0-0b23-45d4-9a94-b2dae72809fe response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67112025-01-13T22:51:59.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fc811b48-18a7-41a1-8a60-42ae6be5fe30 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67122025-01-13T22:51:59.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fc811b48-18a7-41a1-8a60-42ae6be5fe30 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67132025-01-13T22:51:59.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fc811b48-18a7-41a1-8a60-42ae6be5fe30 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67142025-01-13T22:52:00.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 351acab8-3223-4e4f-9792-92ccc9ee65c7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67152025-01-13T22:52:00.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 351acab8-3223-4e4f-9792-92ccc9ee65c7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67162025-01-13T22:52:00.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 351acab8-3223-4e4f-9792-92ccc9ee65c7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
67172025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
67182025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
67192025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67202025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67212025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
67222025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
67232025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67242025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
67252025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67262025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
67272025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
67282025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67292025-01-13T22:52:01.069ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67302025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67312025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
67322025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67332025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
67342025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67352025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67362025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
67372025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67382025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
67392025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
67402025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67412025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67422025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
67432025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67442025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
67452025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67462025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
67472025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67482025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
67492025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67502025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
67512025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67522025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
67532025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67542025-01-13T22:52:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67552025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67562025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67572025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67582025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67592025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67602025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67612025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67622025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67632025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67642025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67652025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67662025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67672025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67682025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67692025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67702025-01-13T22:52:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67712025-01-13T22:52:01.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67722025-01-13T22:52:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67732025-01-13T22:52:01.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3180, tv_nsec: 699450293 } })
67742025-01-13T22:52:01.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67752025-01-13T22:52:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.055508ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67762025-01-13T22:52:01.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67772025-01-13T22:52:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67782025-01-13T22:52:01.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67792025-01-13T22:52:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67802025-01-13T22:52:01.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67812025-01-13T22:52:01.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822025-01-13T22:52:01.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67832025-01-13T22:52:01.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3180, tv_nsec: 709006903 } })
67842025-01-13T22:52:01.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67852025-01-13T22:52:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67862025-01-13T22:52:01.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67872025-01-13T22:52:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67882025-01-13T22:52:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67892025-01-13T22:52:01.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67902025-01-13T22:52:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67912025-01-13T22:52:01.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67922025-01-13T22:52:01.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67932025-01-13T22:52:01.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67942025-01-13T22:52:01.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67952025-01-13T22:52:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67962025-01-13T22:52:01.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67972025-01-13T22:52:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67982025-01-13T22:52:01.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3180, tv_nsec: 717323435 } })
67992025-01-13T22:52:01.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
68002025-01-13T22:52:01.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68012025-01-13T22:52:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68022025-01-13T22:52:01.114ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68032025-01-13T22:52:01.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68042025-01-13T22:52:01.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.166004ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68052025-01-13T22:52:01.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68062025-01-13T22:52:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68072025-01-13T22:52:01.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68082025-01-13T22:52:01.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68092025-01-13T22:52:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68102025-01-13T22:52:01.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68112025-01-13T22:52:01.121ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68122025-01-13T22:52:01.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68132025-01-13T22:52:01.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68142025-01-13T22:52:01.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68152025-01-13T22:52:01.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.504385ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
68162025-01-13T22:52:01.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68172025-01-13T22:52:01.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68182025-01-13T22:52:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68192025-01-13T22:52:01.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68202025-01-13T22:52:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
68212025-01-13T22:52:01.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68222025-01-13T22:52:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68232025-01-13T22:52:01.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68242025-01-13T22:52:01.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68252025-01-13T22:52:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68262025-01-13T22:52:01.130ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.914585ms iteration = 18 status = 0
68272025-01-13T22:52:01.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68282025-01-13T22:52:01.131ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68292025-01-13T22:52:01.131ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68302025-01-13T22:52:01.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68312025-01-13T22:52:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68322025-01-13T22:52:01.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68332025-01-13T22:52:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68342025-01-13T22:52:01.132ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68352025-01-13T22:52:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68362025-01-13T22:52:01.132ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68372025-01-13T22:52:01.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68382025-01-13T22:52:01.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68392025-01-13T22:52:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68402025-01-13T22:52:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68412025-01-13T22:52:01.134ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68422025-01-13T22:52:01.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.839959ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
68432025-01-13T22:52:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68442025-01-13T22:52:01.136ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68452025-01-13T22:52:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68462025-01-13T22:52:01.141ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68472025-01-13T22:52:01.141ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68482025-01-13T22:52:01.142ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0fae2dd-759e-496c-89b5-2af1755392d9", "content-length": "26", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
68492025-01-13T22:52:01.142ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68502025-01-13T22:52:01.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68512025-01-13T22:52:01.144ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68522025-01-13T22:52:01.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
68532025-01-13T22:52:01.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68542025-01-13T22:52:01.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68552025-01-13T22:52:01.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.241796ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68562025-01-13T22:52:01.162ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
68572025-01-13T22:52:01.162ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.376617ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
68582025-01-13T22:52:01.165ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68592025-01-13T22:52:01.165ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.292778ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68602025-01-13T22:52:01.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.815829ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68612025-01-13T22:52:01.174ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68622025-01-13T22:52:01.174ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68632025-01-13T22:52:01.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68642025-01-13T22:52:01.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68652025-01-13T22:52:01.175ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
68662025-01-13T22:52:01.175ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68672025-01-13T22:52:01.175ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "edb4cba7-3d17-447f-a106-11832cce5f8a", "content-length": "26", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
68682025-01-13T22:52:01.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68692025-01-13T22:52:01.175ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.877619ms iteration = 20 status = {"physical_disks_added":0}
68702025-01-13T22:52:01.176ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68712025-01-13T22:52:01.176ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68722025-01-13T22:52:01.176ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
68732025-01-13T22:52:01.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1a8919f-23ff-4231-9671-e07415a71ffa", "content-length": "26", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
68742025-01-13T22:52:01.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68752025-01-13T22:52:01.178ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68762025-01-13T22:52:01.180ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68772025-01-13T22:52:01.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68782025-01-13T22:52:01.182ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68792025-01-13T22:52:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68802025-01-13T22:52:01.184ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68812025-01-13T22:52:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68822025-01-13T22:52:01.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.498342ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68832025-01-13T22:52:01.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68842025-01-13T22:52:01.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68852025-01-13T22:52:01.215ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68862025-01-13T22:52:01.215ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68872025-01-13T22:52:01.215ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.66803ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68882025-01-13T22:52:01.217ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
68892025-01-13T22:52:01.217ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 147.596481ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
68902025-01-13T22:52:01.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68912025-01-13T22:52:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68922025-01-13T22:52:01.246ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 177.441219ms iteration = 18 status = {}
68932025-01-13T22:52:01.264ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68942025-01-13T22:52:01.264ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2978e0ed-0b26-41d8-94f0-78d2a66e000e", "content-length": "1", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
68952025-01-13T22:52:01.265ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68962025-01-13T22:52:01.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68972025-01-13T22:52:01.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 60142031-d0ac-47c3-9f6c-180f4b1fb551 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
68982025-01-13T22:52:01.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 60142031-d0ac-47c3-9f6c-180f4b1fb551 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
68992025-01-13T22:52:01.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 01731d4e-c047-4003-921d-b267290dd21a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
69002025-01-13T22:52:01.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 01731d4e-c047-4003-921d-b267290dd21a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
69012025-01-13T22:52:01.369ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69022025-01-13T22:52:01.369ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69032025-01-13T22:52:01.369ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed9e56e7-29a9-4e8d-851b-4c1e921d44ec", "content-length": "372", "date": "Mon, 13 Jan 2025 22:52:01 GMT"} })
69042025-01-13T22:52:01.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69052025-01-13T22:52:01.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69062025-01-13T22:52:01.370ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69072025-01-13T22:52:01.371ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 302.043217ms iteration = 18 status = null
69082025-01-13T22:52:01.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 60142031-d0ac-47c3-9f6c-180f4b1fb551 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69092025-01-13T22:52:01.372ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69102025-01-13T22:52:01.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69112025-01-13T22:52:01.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69122025-01-13T22:52:01.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 01731d4e-c047-4003-921d-b267290dd21a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
69132025-01-13T22:52:01.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69142025-01-13T22:52:01.376ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69152025-01-13T22:52:01.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69162025-01-13T22:52:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69172025-01-13T22:52:01.412ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69182025-01-13T22:52:01.412ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69192025-01-13T22:52:01.413ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9be8e329-4f82-43fc-8bfc-f618da6ddfa7", "date": "Mon, 13 Jan 2025 22:52:01 GMT"} })
69202025-01-13T22:52:01.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69212025-01-13T22:52:01.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69222025-01-13T22:52:01.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69232025-01-13T22:52:01.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69242025-01-13T22:52:01.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69252025-01-13T22:52:01.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69262025-01-13T22:52:01.416ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
69272025-01-13T22:52:01.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69282025-01-13T22:52:01.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69292025-01-13T22:52:01.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69302025-01-13T22:52:01.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69312025-01-13T22:52:01.420ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69322025-01-13T22:52:01.420ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69332025-01-13T22:52:01.421ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b3797185-8471-4f6f-a40a-88a222ede161", "date": "Mon, 13 Jan 2025 22:52:01 GMT"} })
69342025-01-13T22:52:01.422ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.120624ms iteration = 18 status = {}
69352025-01-13T22:52:01.426ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69362025-01-13T22:52:01.426ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2f68d67-7bc5-47f8-9ce2-a9933294aef3", "content-length": "134", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
69372025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69382025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
69392025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69402025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69412025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69422025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69432025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69442025-01-13T22:52:01.426ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69452025-01-13T22:52:01.427ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69462025-01-13T22:52:01.427ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69472025-01-13T22:52:01.427ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
69482025-01-13T22:52:01.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69492025-01-13T22:52:01.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69502025-01-13T22:52:01.428ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69512025-01-13T22:52:01.429ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5705e9dd-b29c-40ea-bb97-b5c03a234a53", "content-length": "2", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
69522025-01-13T22:52:01.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69532025-01-13T22:52:01.429ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc0ffec3-1f05-458e-9b95-d19bce9619eb", "content-length": "51", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
69542025-01-13T22:52:01.429ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
69552025-01-13T22:52:01.429ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69562025-01-13T22:52:01.461ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69572025-01-13T22:52:01.521ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e5a1d833-5017-4015-8669-f2e4e7b51e32", "date": "Mon, 13 Jan 2025 22:52:01 GMT"} })
69582025-01-13T22:52:01.521ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
69592025-01-13T22:52:01.521ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69602025-01-13T22:52:01.521ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4237029b-cccc-457b-9357-5c517be4d2a1", "content-length": "691", "date": "Mon, 13 Jan 2025 22:52:01 GMT"} })
69612025-01-13T22:52:01.521ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
69622025-01-13T22:52:01.521ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
69632025-01-13T22:52:01.521ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
69642025-01-13T22:52:01.521ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b753cb-42da-4745-bf73-a4b5c20ba13f", "content-length": "682", "date": "Mon, 13 Jan 2025 22:52:00 GMT"} })
69652025-01-13T22:52:01.521ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69662025-01-13T22:52:01.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69672025-01-13T22:52:01.522ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.921133ms iteration = 18 status = {}
69682025-01-13T22:52:01.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69692025-01-13T22:52:01.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69702025-01-13T22:52:01.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69712025-01-13T22:52:01.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69722025-01-13T22:52:01.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69732025-01-13T22:52:01.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69742025-01-13T22:52:01.538ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.77244ms iteration = 18 status = {}
69752025-01-13T22:52:01.754ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
69762025-01-13T22:52:01.754ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
69772025-01-13T22:52:01.785ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
69782025-01-13T22:52:01.785ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33981
69792025-01-13T22:52:01.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33981 req_id = cd2e0516-d224-4ece-bde5-704965a3d377 roles = RoleSet { roles: {} } uri = /metrics/producers
69802025-01-13T22:52:01.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33981 req_id = cd2e0516-d224-4ece-bde5-704965a3d377 resource = Database result = Ok(()) uri = /metrics/producers
69812025-01-13T22:52:01.830ZINFOnexus: assigned collector to new producer collector_id = 6a8a13ba-b82f-41ac-997c-fb535838d6a4 file = nexus/src/app/oximeter.rs:76 producer_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
69822025-01-13T22:52:01.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45094 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33981 req_id = cd2e0516-d224-4ece-bde5-704965a3d377 response_code = 201 uri = /metrics/producers
69832025-01-13T22:52:01.830ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cd2e0516-d224-4ece-bde5-704965a3d377", "content-length": "41", "date": "Mon, 13 Jan 2025 22:52:01 GMT"} })
69842025-01-13T22:52:01.831ZDEBGnexus (producer-registration-task): registered with nexus successfully
69852025-01-13T22:52:01.831ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
69862025-01-13T22:52:02.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b01d5d13-f7b4-4070-82bc-a3e2e1324a32 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69872025-01-13T22:52:02.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b01d5d13-f7b4-4070-82bc-a3e2e1324a32 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69882025-01-13T22:52:02.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b01d5d13-f7b4-4070-82bc-a3e2e1324a32 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69892025-01-13T22:52:03.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bbc9b897-25db-4bde-8db8-f0d89a4cce44 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69902025-01-13T22:52:03.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bbc9b897-25db-4bde-8db8-f0d89a4cce44 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69912025-01-13T22:52:03.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bbc9b897-25db-4bde-8db8-f0d89a4cce44 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69922025-01-13T22:52:03.509ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 47739f7d-e77b-4c20-8750-b38876a8da24 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
69932025-01-13T22:52:04.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa322504-a5ad-4b2e-8a05-2109983bb344 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69942025-01-13T22:52:04.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa322504-a5ad-4b2e-8a05-2109983bb344 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69952025-01-13T22:52:04.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fa322504-a5ad-4b2e-8a05-2109983bb344 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69962025-01-13T22:52:05.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2fc1d0f7-7972-47f5-8f01-3448ce0918d4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69972025-01-13T22:52:05.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2fc1d0f7-7972-47f5-8f01-3448ce0918d4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69982025-01-13T22:52:05.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2fc1d0f7-7972-47f5-8f01-3448ce0918d4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
69992025-01-13T22:52:06.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3f5ed4d0-747e-498d-98e2-f320be91efc7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70002025-01-13T22:52:06.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3f5ed4d0-747e-498d-98e2-f320be91efc7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70012025-01-13T22:52:06.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3f5ed4d0-747e-498d-98e2-f320be91efc7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70022025-01-13T22:52:07.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7669eb5f-e142-4025-b652-05ac37646125 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70032025-01-13T22:52:07.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7669eb5f-e142-4025-b652-05ac37646125 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70042025-01-13T22:52:07.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7669eb5f-e142-4025-b652-05ac37646125 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70052025-01-13T22:52:08.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3cb6034-9563-45d1-85bf-12311991f1b2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70062025-01-13T22:52:08.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3cb6034-9563-45d1-85bf-12311991f1b2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70072025-01-13T22:52:08.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3cb6034-9563-45d1-85bf-12311991f1b2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70082025-01-13T22:52:09.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4126a4f3-4a3d-48a8-98c2-0ca69ec00b9e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70092025-01-13T22:52:09.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4126a4f3-4a3d-48a8-98c2-0ca69ec00b9e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70102025-01-13T22:52:09.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4126a4f3-4a3d-48a8-98c2-0ca69ec00b9e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70112025-01-13T22:52:10.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a99041bc-2569-4b13-ab7d-c0422231bf77 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70122025-01-13T22:52:10.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a99041bc-2569-4b13-ab7d-c0422231bf77 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70132025-01-13T22:52:10.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a99041bc-2569-4b13-ab7d-c0422231bf77 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70142025-01-13T22:52:11.069ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
70152025-01-13T22:52:11.069ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
70162025-01-13T22:52:11.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70172025-01-13T22:52:11.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70182025-01-13T22:52:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70192025-01-13T22:52:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70202025-01-13T22:52:11.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212025-01-13T22:52:11.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70222025-01-13T22:52:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70232025-01-13T22:52:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70242025-01-13T22:52:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70252025-01-13T22:52:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70262025-01-13T22:52:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70272025-01-13T22:52:11.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70282025-01-13T22:52:11.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292025-01-13T22:52:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
70302025-01-13T22:52:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70312025-01-13T22:52:11.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70322025-01-13T22:52:11.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
70332025-01-13T22:52:11.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.316021ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
70342025-01-13T22:52:11.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.520133ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70352025-01-13T22:52:11.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 18212047-09b1-432e-909f-58b6fd73c7fe roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70362025-01-13T22:52:11.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 18212047-09b1-432e-909f-58b6fd73c7fe resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70372025-01-13T22:52:11.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 18212047-09b1-432e-909f-58b6fd73c7fe response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70382025-01-13T22:52:12.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 784878d3-ae63-4a64-94ca-57730e235a3b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70392025-01-13T22:52:12.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 784878d3-ae63-4a64-94ca-57730e235a3b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70402025-01-13T22:52:12.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 784878d3-ae63-4a64-94ca-57730e235a3b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70412025-01-13T22:52:13.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 3815d5ef-0720-45d5-9680-882c69f6e8af roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
70422025-01-13T22:52:13.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 3815d5ef-0720-45d5-9680-882c69f6e8af resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
70432025-01-13T22:52:13.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 3815d5ef-0720-45d5-9680-882c69f6e8af response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
70442025-01-13T22:52:13.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = d87d1803-5a42-47ee-bf0f-fbcab6adf99f roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
70452025-01-13T22:52:13.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = d87d1803-5a42-47ee-bf0f-fbcab6adf99f resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
70462025-01-13T22:52:13.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = d87d1803-5a42-47ee-bf0f-fbcab6adf99f response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
70472025-01-13T22:52:13.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 4813476c-dc6a-4ae4-993b-7ef981829851 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
70482025-01-13T22:52:13.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 87b6ab9f-a511-4da3-9757-ae4d8a653161 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70492025-01-13T22:52:13.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 87b6ab9f-a511-4da3-9757-ae4d8a653161 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70502025-01-13T22:52:13.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 87b6ab9f-a511-4da3-9757-ae4d8a653161 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70512025-01-13T22:52:14.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9003b187-da2d-427b-bb1a-9f79ab05c0c9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70522025-01-13T22:52:14.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9003b187-da2d-427b-bb1a-9f79ab05c0c9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70532025-01-13T22:52:14.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9003b187-da2d-427b-bb1a-9f79ab05c0c9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70542025-01-13T22:52:15.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2702b9ab-1c54-4811-a29f-4fb5095a4ba9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70552025-01-13T22:52:15.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2702b9ab-1c54-4811-a29f-4fb5095a4ba9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70562025-01-13T22:52:15.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2702b9ab-1c54-4811-a29f-4fb5095a4ba9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70572025-01-13T22:52:16.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7626cef8-08a4-4cf6-af99-8619049f60ca roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70582025-01-13T22:52:16.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7626cef8-08a4-4cf6-af99-8619049f60ca resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70592025-01-13T22:52:16.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7626cef8-08a4-4cf6-af99-8619049f60ca response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70602025-01-13T22:52:17.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ef801295-4f3a-41d6-8d3f-656c73971190 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70612025-01-13T22:52:17.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ef801295-4f3a-41d6-8d3f-656c73971190 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70622025-01-13T22:52:17.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ef801295-4f3a-41d6-8d3f-656c73971190 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70632025-01-13T22:52:18.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e58581dc-5e60-47d8-b6c8-3b71fbe90995 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70642025-01-13T22:52:18.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e58581dc-5e60-47d8-b6c8-3b71fbe90995 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70652025-01-13T22:52:18.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e58581dc-5e60-47d8-b6c8-3b71fbe90995 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70662025-01-13T22:52:19.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1555f39d-79cb-47fa-96cf-fb1f1c13a60d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70672025-01-13T22:52:19.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1555f39d-79cb-47fa-96cf-fb1f1c13a60d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70682025-01-13T22:52:19.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1555f39d-79cb-47fa-96cf-fb1f1c13a60d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70692025-01-13T22:52:20.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67eef9ee-9434-4b08-9093-ae071e33839e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70702025-01-13T22:52:20.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67eef9ee-9434-4b08-9093-ae071e33839e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70712025-01-13T22:52:20.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 67eef9ee-9434-4b08-9093-ae071e33839e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70722025-01-13T22:52:21.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
70732025-01-13T22:52:21.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
70742025-01-13T22:52:21.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70752025-01-13T22:52:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70762025-01-13T22:52:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70772025-01-13T22:52:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70782025-01-13T22:52:21.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70792025-01-13T22:52:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70802025-01-13T22:52:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70812025-01-13T22:52:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70822025-01-13T22:52:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70832025-01-13T22:52:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70842025-01-13T22:52:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70852025-01-13T22:52:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
70862025-01-13T22:52:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70872025-01-13T22:52:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70882025-01-13T22:52:21.094ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
70892025-01-13T22:52:21.094ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.781121ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
70902025-01-13T22:52:21.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70912025-01-13T22:52:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70922025-01-13T22:52:21.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.216377ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70932025-01-13T22:52:21.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d4ca851e-f843-4fe8-a9c2-4fdd1b2f8066 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70942025-01-13T22:52:21.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d4ca851e-f843-4fe8-a9c2-4fdd1b2f8066 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70952025-01-13T22:52:21.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d4ca851e-f843-4fe8-a9c2-4fdd1b2f8066 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70962025-01-13T22:52:22.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb92e355-4f0e-4afe-b3ff-ed1b6fcc46bc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70972025-01-13T22:52:22.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb92e355-4f0e-4afe-b3ff-ed1b6fcc46bc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70982025-01-13T22:52:22.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb92e355-4f0e-4afe-b3ff-ed1b6fcc46bc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
70992025-01-13T22:52:23.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 295e5937-1088-4c6c-88ce-984dc3d0ec24 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
71002025-01-13T22:52:23.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6763b399-e729-4aa0-9c5d-77573e0204c1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71012025-01-13T22:52:23.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6763b399-e729-4aa0-9c5d-77573e0204c1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71022025-01-13T22:52:23.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6763b399-e729-4aa0-9c5d-77573e0204c1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71032025-01-13T22:52:24.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f747b6ea-3751-40b7-b84f-2ac00fee1ec9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71042025-01-13T22:52:24.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f747b6ea-3751-40b7-b84f-2ac00fee1ec9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71052025-01-13T22:52:24.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f747b6ea-3751-40b7-b84f-2ac00fee1ec9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71062025-01-13T22:52:25.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a200228c-450d-41c4-a7a3-9e92eb539ec8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71072025-01-13T22:52:25.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a200228c-450d-41c4-a7a3-9e92eb539ec8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71082025-01-13T22:52:25.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a200228c-450d-41c4-a7a3-9e92eb539ec8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71092025-01-13T22:52:26.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 442799ec-b291-4c5c-817b-408d6be3b2ec roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71102025-01-13T22:52:26.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 442799ec-b291-4c5c-817b-408d6be3b2ec resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71112025-01-13T22:52:26.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 442799ec-b291-4c5c-817b-408d6be3b2ec response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71122025-01-13T22:52:27.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ba1b08b-85eb-4368-b89a-455a1bb49994 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71132025-01-13T22:52:27.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ba1b08b-85eb-4368-b89a-455a1bb49994 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71142025-01-13T22:52:27.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1ba1b08b-85eb-4368-b89a-455a1bb49994 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71152025-01-13T22:52:28.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e58c386f-5712-4398-a738-a8c0858a08fc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71162025-01-13T22:52:28.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e58c386f-5712-4398-a738-a8c0858a08fc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71172025-01-13T22:52:28.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e58c386f-5712-4398-a738-a8c0858a08fc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71182025-01-13T22:52:29.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a2965573-36c5-4cfa-893e-2333704c9bbd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71192025-01-13T22:52:29.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a2965573-36c5-4cfa-893e-2333704c9bbd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71202025-01-13T22:52:29.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a2965573-36c5-4cfa-893e-2333704c9bbd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71212025-01-13T22:52:30.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bf364435-34de-4737-b5ba-71428c0ca4ff roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71222025-01-13T22:52:30.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bf364435-34de-4737-b5ba-71428c0ca4ff resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71232025-01-13T22:52:30.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bf364435-34de-4737-b5ba-71428c0ca4ff response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
71242025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
71252025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71262025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
71272025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71282025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
71292025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
71302025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
71312025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71322025-01-13T22:52:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
71332025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
71342025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71352025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71362025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71372025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71382025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71392025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
71402025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71412025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
71422025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71432025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
71442025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
71452025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71462025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
71472025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71482025-01-13T22:52:31.068ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
71492025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
71502025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.69\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
71512025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71522025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
71532025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
71542025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71552025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71562025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
71572025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71582025-01-13T22:52:31.068ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3210, tv_nsec: 695494588 } })
71592025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
71602025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71612025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
71622025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71632025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
71642025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
71652025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71662025-01-13T22:52:31.068ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71672025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
71682025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71692025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71702025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
71712025-01-13T22:52:31.068ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:42:31.068617807 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71722025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71732025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
71742025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71752025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
71762025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71772025-01-13T22:52:31.068ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71782025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
71792025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71802025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
71812025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
71822025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71832025-01-13T22:52:31.068ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3210, tv_nsec: 695640223 } })
71842025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71852025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
71862025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
71872025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71882025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71892025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
71902025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71912025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71922025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
71932025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71942025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
71952025-01-13T22:52:31.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71962025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71972025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71982025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71992025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72002025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72012025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72022025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72032025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72042025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72052025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
72062025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72072025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
72082025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72092025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72102025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.247109ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
72112025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72122025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72132025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
72142025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72152025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72162025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72172025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72182025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72192025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72202025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72212025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
72222025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72232025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
72242025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.411255ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
72252025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72262025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72272025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72282025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72292025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72302025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72312025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72322025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72332025-01-13T22:52:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72342025-01-13T22:52:31.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72352025-01-13T22:52:31.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72362025-01-13T22:52:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.405159ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72372025-01-13T22:52:31.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3210, tv_nsec: 700168405 } })
72382025-01-13T22:52:31.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72392025-01-13T22:52:31.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72402025-01-13T22:52:31.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72412025-01-13T22:52:31.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72422025-01-13T22:52:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72432025-01-13T22:52:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72442025-01-13T22:52:31.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72452025-01-13T22:52:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72462025-01-13T22:52:31.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.957299ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
72472025-01-13T22:52:31.075ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3210, tv_nsec: 702431426 } })
72482025-01-13T22:52:31.075ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72492025-01-13T22:52:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72502025-01-13T22:52:31.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72512025-01-13T22:52:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72522025-01-13T22:52:31.078ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72532025-01-13T22:52:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72542025-01-13T22:52:31.079ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.80211ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
72552025-01-13T22:52:31.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72562025-01-13T22:52:31.081ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72572025-01-13T22:52:31.081ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:42:31.068617807 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72582025-01-13T22:52:31.081ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.151144ms iteration = 10 status = {"expiration":"2025-01-13T22:42:31.068617807Z","pruned":[]}
72592025-01-13T22:52:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72602025-01-13T22:52:31.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72612025-01-13T22:52:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72622025-01-13T22:52:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72632025-01-13T22:52:31.084ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72642025-01-13T22:52:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72652025-01-13T22:52:31.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72662025-01-13T22:52:31.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672025-01-13T22:52:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72682025-01-13T22:52:31.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72692025-01-13T22:52:31.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72702025-01-13T22:52:31.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72712025-01-13T22:52:31.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72722025-01-13T22:52:31.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72732025-01-13T22:52:31.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72742025-01-13T22:52:31.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72752025-01-13T22:52:31.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72762025-01-13T22:52:31.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772025-01-13T22:52:31.097ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72782025-01-13T22:52:31.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72792025-01-13T22:52:31.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72802025-01-13T22:52:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72812025-01-13T22:52:31.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72822025-01-13T22:52:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72832025-01-13T22:52:31.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72842025-01-13T22:52:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72852025-01-13T22:52:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72862025-01-13T22:52:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72872025-01-13T22:52:31.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.715331ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72882025-01-13T22:52:31.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3210, tv_nsec: 742971061 } })
72892025-01-13T22:52:31.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72902025-01-13T22:52:31.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
72912025-01-13T22:52:31.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72922025-01-13T22:52:31.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72932025-01-13T22:52:31.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72942025-01-13T22:52:31.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.253345ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
72952025-01-13T22:52:31.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72962025-01-13T22:52:31.123ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72972025-01-13T22:52:31.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72982025-01-13T22:52:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72992025-01-13T22:52:31.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73002025-01-13T22:52:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73012025-01-13T22:52:31.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73022025-01-13T22:52:31.127ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73032025-01-13T22:52:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73042025-01-13T22:52:31.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73052025-01-13T22:52:31.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73062025-01-13T22:52:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73072025-01-13T22:52:31.129ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73082025-01-13T22:52:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73092025-01-13T22:52:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73102025-01-13T22:52:31.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73112025-01-13T22:52:31.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73122025-01-13T22:52:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73132025-01-13T22:52:31.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142025-01-13T22:52:31.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73152025-01-13T22:52:31.135ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73162025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73172025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73182025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73192025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73202025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73212025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73222025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73232025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73242025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73252025-01-13T22:52:31.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73262025-01-13T22:52:31.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73272025-01-13T22:52:31.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
73282025-01-13T22:52:31.136ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73292025-01-13T22:52:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73302025-01-13T22:52:31.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73312025-01-13T22:52:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73322025-01-13T22:52:31.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332025-01-13T22:52:31.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73342025-01-13T22:52:31.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73352025-01-13T22:52:31.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73362025-01-13T22:52:31.141ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73372025-01-13T22:52:31.141ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73382025-01-13T22:52:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73392025-01-13T22:52:31.141ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73402025-01-13T22:52:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73412025-01-13T22:52:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73422025-01-13T22:52:31.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73432025-01-13T22:52:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73442025-01-13T22:52:31.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73452025-01-13T22:52:31.146ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
73462025-01-13T22:52:31.146ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
73472025-01-13T22:52:31.146ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.55735ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
73482025-01-13T22:52:31.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.433938ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73492025-01-13T22:52:31.149ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73502025-01-13T22:52:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73512025-01-13T22:52:31.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73522025-01-13T22:52:31.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73532025-01-13T22:52:31.150ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
73542025-01-13T22:52:31.150ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
73552025-01-13T22:52:31.150ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
73562025-01-13T22:52:31.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73572025-01-13T22:52:31.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73582025-01-13T22:52:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
73592025-01-13T22:52:31.152ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73602025-01-13T22:52:31.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73612025-01-13T22:52:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73622025-01-13T22:52:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73632025-01-13T22:52:31.154ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73642025-01-13T22:52:31.154ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
73652025-01-13T22:52:31.154ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.821219ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73662025-01-13T22:52:31.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73672025-01-13T22:52:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73682025-01-13T22:52:31.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73692025-01-13T22:52:31.157ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 88.624557ms iteration = 5 status = {"nsuccess":5}
73702025-01-13T22:52:31.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73712025-01-13T22:52:31.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73722025-01-13T22:52:31.158ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73732025-01-13T22:52:31.158ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.051932ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73742025-01-13T22:52:31.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73752025-01-13T22:52:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73762025-01-13T22:52:31.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73772025-01-13T22:52:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73782025-01-13T22:52:31.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
73792025-01-13T22:52:31.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73802025-01-13T22:52:31.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73812025-01-13T22:52:31.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822025-01-13T22:52:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
73832025-01-13T22:52:31.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73842025-01-13T22:52:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73852025-01-13T22:52:31.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73862025-01-13T22:52:31.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73872025-01-13T22:52:31.165ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73882025-01-13T22:52:31.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73892025-01-13T22:52:31.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73902025-01-13T22:52:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73912025-01-13T22:52:31.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.106697ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73922025-01-13T22:52:31.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73932025-01-13T22:52:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73942025-01-13T22:52:31.185ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73952025-01-13T22:52:31.185ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73962025-01-13T22:52:31.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73972025-01-13T22:52:31.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73982025-01-13T22:52:31.187ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73992025-01-13T22:52:31.187ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74002025-01-13T22:52:31.187ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.329672ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74012025-01-13T22:52:31.189ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
74022025-01-13T22:52:31.189ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
74032025-01-13T22:52:31.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74042025-01-13T22:52:31.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74052025-01-13T22:52:31.227ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74062025-01-13T22:52:31.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74072025-01-13T22:52:31.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74082025-01-13T22:52:31.235ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74092025-01-13T22:52:31.235ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74102025-01-13T22:52:31.236ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82de2b7e-ac53-4646-94f6-f1aff4acabc1", "content-length": "26", "date": "Mon, 13 Jan 2025 22:52:30 GMT"} })
74112025-01-13T22:52:31.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74122025-01-13T22:52:31.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74132025-01-13T22:52:31.246ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.205623ms iteration = 21 status = {"physical_disks_added":0}
74142025-01-13T22:52:31.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
74152025-01-13T22:52:31.318ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74162025-01-13T22:52:31.318ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8dad54e-f365-4f37-9fbd-31d7020cebb8", "content-length": "26", "date": "Mon, 13 Jan 2025 22:52:30 GMT"} })
74172025-01-13T22:52:31.318ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74182025-01-13T22:52:31.320ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
74192025-01-13T22:52:31.320ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74202025-01-13T22:52:31.320ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74212025-01-13T22:52:31.321ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aaffe54-9c3b-4980-8617-2ae701a59d0c", "content-length": "372", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
74222025-01-13T22:52:31.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74232025-01-13T22:52:31.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74242025-01-13T22:52:31.323ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 255.01618ms iteration = 19 status = 0
74252025-01-13T22:52:31.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74262025-01-13T22:52:31.324ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74272025-01-13T22:52:31.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74282025-01-13T22:52:31.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74292025-01-13T22:52:31.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74302025-01-13T22:52:31.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74312025-01-13T22:52:31.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
74322025-01-13T22:52:31.326ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74332025-01-13T22:52:31.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74342025-01-13T22:52:31.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74352025-01-13T22:52:31.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74362025-01-13T22:52:31.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74372025-01-13T22:52:31.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74382025-01-13T22:52:31.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
74392025-01-13T22:52:31.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 262.489284ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
74402025-01-13T22:52:31.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74412025-01-13T22:52:31.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74422025-01-13T22:52:31.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74432025-01-13T22:52:31.332ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
74442025-01-13T22:52:31.332ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74452025-01-13T22:52:31.332ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
74462025-01-13T22:52:31.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 264.509428ms iteration = 10 status = {"generation":1}
74472025-01-13T22:52:31.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74482025-01-13T22:52:31.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74492025-01-13T22:52:31.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74502025-01-13T22:52:31.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74512025-01-13T22:52:31.357ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
74522025-01-13T22:52:31.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 291.476405ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
74532025-01-13T22:52:31.361ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
74542025-01-13T22:52:31.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 292.753486ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
74552025-01-13T22:52:31.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74562025-01-13T22:52:31.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74572025-01-13T22:52:31.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74582025-01-13T22:52:31.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74592025-01-13T22:52:31.368ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
74602025-01-13T22:52:31.368ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 299.950412ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
74612025-01-13T22:52:31.369ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
74622025-01-13T22:52:31.369ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
74632025-01-13T22:52:31.369ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
74642025-01-13T22:52:31.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 301.1562ms iteration = 10 status = {"generation":2}
74652025-01-13T22:52:31.385ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
74662025-01-13T22:52:31.385ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74672025-01-13T22:52:31.386ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7f253ea9-def1-48f8-a668-e31e76dab19e", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
74682025-01-13T22:52:31.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74692025-01-13T22:52:31.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74702025-01-13T22:52:31.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74712025-01-13T22:52:31.386ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74722025-01-13T22:52:31.386ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40b5b46a-5b51-4134-bdea-d6070b285a3e", "content-length": "26", "date": "Mon, 13 Jan 2025 22:52:30 GMT"} })
74732025-01-13T22:52:31.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74742025-01-13T22:52:31.387ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
74752025-01-13T22:52:31.387ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 319.350103ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74762025-01-13T22:52:31.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74772025-01-13T22:52:31.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74782025-01-13T22:52:31.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74792025-01-13T22:52:31.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74802025-01-13T22:52:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74812025-01-13T22:52:31.396ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74822025-01-13T22:52:31.396ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74832025-01-13T22:52:31.396ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af30767e-49f3-47f1-a411-2c44a1f9acdf", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
74842025-01-13T22:52:31.397ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.334177ms iteration = 19 status = {}
74852025-01-13T22:52:31.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 494847df-2fd9-45ac-a305-a40a61127de7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74862025-01-13T22:52:31.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 494847df-2fd9-45ac-a305-a40a61127de7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74872025-01-13T22:52:31.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 494847df-2fd9-45ac-a305-a40a61127de7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74882025-01-13T22:52:31.410ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
74892025-01-13T22:52:31.429ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74902025-01-13T22:52:31.429ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4baf165b-0e36-4743-9a48-a38e40e26c7f", "content-length": "1", "date": "Mon, 13 Jan 2025 22:52:30 GMT"} })
74912025-01-13T22:52:31.431ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74922025-01-13T22:52:31.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74932025-01-13T22:52:31.518ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 449.835396ms iteration = 19 status = {}
74942025-01-13T22:52:31.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74952025-01-13T22:52:31.555ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2278f7a3-dd27-4a88-bf4c-09c2eab2c9de", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
74962025-01-13T22:52:31.555ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
74972025-01-13T22:52:31.556ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9eb110ad-cb5e-4ab9-ae0b-a5213286445b", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
74982025-01-13T22:52:31.556ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
74992025-01-13T22:52:31.558ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b7646065-7f53-45c7-9c37-1e2021b4db82", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
75002025-01-13T22:52:31.558ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
75012025-01-13T22:52:31.560ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
75022025-01-13T22:52:31.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 492.178387ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75032025-01-13T22:52:31.597ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
75042025-01-13T22:52:31.598ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "39fc57a2-6e24-43da-9a4c-050439ded6e7", "date": "Mon, 13 Jan 2025 22:52:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
75052025-01-13T22:52:31.598ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
75062025-01-13T22:52:31.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7d3066cd-c325-4ed6-9e60-2725efd2f7a0", "date": "Mon, 13 Jan 2025 22:52:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
75072025-01-13T22:52:31.599ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
75082025-01-13T22:52:31.601ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
75092025-01-13T22:52:31.601ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 533.898089ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
75102025-01-13T22:52:31.618ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75112025-01-13T22:52:31.618ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4de58831-624d-4be5-a7a0-471744b25dd5", "content-length": "691", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
75122025-01-13T22:52:31.618ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
75132025-01-13T22:52:31.618ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
75142025-01-13T22:52:31.618ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
75152025-01-13T22:52:31.619ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 550.748879ms iteration = 19 status = {}
75162025-01-13T22:52:31.620ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 551.788112ms iteration = 19 status = null
75172025-01-13T22:52:31.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75182025-01-13T22:52:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75192025-01-13T22:52:31.638ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
75202025-01-13T22:52:31.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75212025-01-13T22:52:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75222025-01-13T22:52:31.647ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75232025-01-13T22:52:31.648ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "44b80ad3-7187-4bd2-a229-645acd999a6c", "content-length": "134", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
75242025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75252025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
75262025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75272025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75282025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75292025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75302025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75312025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75322025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75332025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75342025-01-13T22:52:31.648ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
75352025-01-13T22:52:31.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75362025-01-13T22:52:31.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75372025-01-13T22:52:31.650ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75382025-01-13T22:52:31.650ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd6e3dc5-6c16-4643-b074-dd455765f010", "content-length": "2", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
75392025-01-13T22:52:31.650ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75402025-01-13T22:52:31.650ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "23bbf4af-d595-4236-9954-5ab8a54dbd8e", "content-length": "51", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
75412025-01-13T22:52:31.650ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
75422025-01-13T22:52:31.650ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75432025-01-13T22:52:31.741ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a3a054a4-4c6d-404f-a921-11d151e7930a", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
75442025-01-13T22:52:31.741ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
75452025-01-13T22:52:31.741ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75462025-01-13T22:52:31.741ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6e6d184-6a82-47ba-a924-b40c93e32f55", "content-length": "682", "date": "Mon, 13 Jan 2025 22:52:31 GMT"} })
75472025-01-13T22:52:31.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75482025-01-13T22:52:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75492025-01-13T22:52:31.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75502025-01-13T22:52:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75512025-01-13T22:52:31.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75522025-01-13T22:52:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75532025-01-13T22:52:31.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75542025-01-13T22:52:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75552025-01-13T22:52:31.758ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.810412ms iteration = 19 status = {}
75562025-01-13T22:52:32.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36d6a575-3021-4847-a633-c1ed7f1fe2d6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75572025-01-13T22:52:32.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36d6a575-3021-4847-a633-c1ed7f1fe2d6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75582025-01-13T22:52:32.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 36d6a575-3021-4847-a633-c1ed7f1fe2d6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75592025-01-13T22:52:33.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ced1236c-0b39-4ceb-b7f5-5e5530346f66 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75602025-01-13T22:52:33.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ced1236c-0b39-4ceb-b7f5-5e5530346f66 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75612025-01-13T22:52:33.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ced1236c-0b39-4ceb-b7f5-5e5530346f66 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75622025-01-13T22:52:33.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 00bce49b-907c-4d55-9d65-57cfbeb07b36 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
75632025-01-13T22:52:34.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 683c030a-5f14-4037-b7ec-54a0057583cd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75642025-01-13T22:52:34.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 683c030a-5f14-4037-b7ec-54a0057583cd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75652025-01-13T22:52:34.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 683c030a-5f14-4037-b7ec-54a0057583cd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75662025-01-13T22:52:35.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8989089c-b11e-4c19-afff-6e7b34aa4250 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75672025-01-13T22:52:35.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8989089c-b11e-4c19-afff-6e7b34aa4250 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75682025-01-13T22:52:35.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8989089c-b11e-4c19-afff-6e7b34aa4250 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75692025-01-13T22:52:36.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3db38d3-d503-430e-92d9-6726d4de6471 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75702025-01-13T22:52:36.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3db38d3-d503-430e-92d9-6726d4de6471 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75712025-01-13T22:52:36.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3db38d3-d503-430e-92d9-6726d4de6471 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75722025-01-13T22:52:37.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 63ad0b87-539b-4a53-86bb-988ba827bdde roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75732025-01-13T22:52:37.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 63ad0b87-539b-4a53-86bb-988ba827bdde resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75742025-01-13T22:52:37.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 63ad0b87-539b-4a53-86bb-988ba827bdde response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75752025-01-13T22:52:38.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 75cf431a-4545-4521-aaed-321270f39471 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75762025-01-13T22:52:38.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 75cf431a-4545-4521-aaed-321270f39471 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75772025-01-13T22:52:38.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 75cf431a-4545-4521-aaed-321270f39471 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75782025-01-13T22:52:39.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3302262-3867-4f63-8835-65d138cf9898 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75792025-01-13T22:52:39.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3302262-3867-4f63-8835-65d138cf9898 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75802025-01-13T22:52:39.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3302262-3867-4f63-8835-65d138cf9898 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75812025-01-13T22:52:40.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f7e78f64-b6f2-4574-9d93-22e094ffbeec roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75822025-01-13T22:52:40.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f7e78f64-b6f2-4574-9d93-22e094ffbeec resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75832025-01-13T22:52:40.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f7e78f64-b6f2-4574-9d93-22e094ffbeec response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
75842025-01-13T22:52:41.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
75852025-01-13T22:52:41.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
75862025-01-13T22:52:41.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75872025-01-13T22:52:41.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75882025-01-13T22:52:41.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75892025-01-13T22:52:41.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75902025-01-13T22:52:41.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75912025-01-13T22:52:41.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75922025-01-13T22:52:41.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75932025-01-13T22:52:41.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75942025-01-13T22:52:41.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75952025-01-13T22:52:41.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75962025-01-13T22:52:41.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75972025-01-13T22:52:41.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75982025-01-13T22:52:41.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75992025-01-13T22:52:41.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
76002025-01-13T22:52:41.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76012025-01-13T22:52:41.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76022025-01-13T22:52:41.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
76032025-01-13T22:52:41.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.394959ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
76042025-01-13T22:52:41.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.102843ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76052025-01-13T22:52:41.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cff714ad-c1d0-47a2-b1e6-b2fe376c8c6e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76062025-01-13T22:52:41.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cff714ad-c1d0-47a2-b1e6-b2fe376c8c6e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76072025-01-13T22:52:41.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cff714ad-c1d0-47a2-b1e6-b2fe376c8c6e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76082025-01-13T22:52:42.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 137ee2b7-9da8-4078-b9f9-4ebf33298ea2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76092025-01-13T22:52:42.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 137ee2b7-9da8-4078-b9f9-4ebf33298ea2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76102025-01-13T22:52:42.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 137ee2b7-9da8-4078-b9f9-4ebf33298ea2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76112025-01-13T22:52:43.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd996e2d-bcc6-40b2-abf0-41aa27d03e1c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76122025-01-13T22:52:43.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd996e2d-bcc6-40b2-abf0-41aa27d03e1c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76132025-01-13T22:52:43.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd996e2d-bcc6-40b2-abf0-41aa27d03e1c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76142025-01-13T22:52:43.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = d7bb46f7-1df8-4311-a7c3-798ac3a46f6e response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
76152025-01-13T22:52:44.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55e64e07-8303-4551-b7a8-1d6d9297ea37 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76162025-01-13T22:52:44.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55e64e07-8303-4551-b7a8-1d6d9297ea37 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76172025-01-13T22:52:44.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55e64e07-8303-4551-b7a8-1d6d9297ea37 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76182025-01-13T22:52:45.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 497b177d-6e80-41c5-9f02-7bb389fe5752 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76192025-01-13T22:52:45.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 497b177d-6e80-41c5-9f02-7bb389fe5752 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76202025-01-13T22:52:45.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 497b177d-6e80-41c5-9f02-7bb389fe5752 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76212025-01-13T22:52:46.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 767924f0-39f9-4b4b-bafe-ab88bf5f8dad roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76222025-01-13T22:52:46.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 767924f0-39f9-4b4b-bafe-ab88bf5f8dad resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76232025-01-13T22:52:46.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 767924f0-39f9-4b4b-bafe-ab88bf5f8dad response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76242025-01-13T22:52:47.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 74f38fc3-c35d-4f11-9554-6385bf1fed74 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76252025-01-13T22:52:47.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 74f38fc3-c35d-4f11-9554-6385bf1fed74 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76262025-01-13T22:52:47.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 74f38fc3-c35d-4f11-9554-6385bf1fed74 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76272025-01-13T22:52:48.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 38f2792b-1e84-4070-aef0-24678e400aea roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76282025-01-13T22:52:48.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 38f2792b-1e84-4070-aef0-24678e400aea resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76292025-01-13T22:52:48.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 38f2792b-1e84-4070-aef0-24678e400aea response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76302025-01-13T22:52:49.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4a5d879e-051a-4dd8-8379-d7c2b13ac84a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76312025-01-13T22:52:49.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4a5d879e-051a-4dd8-8379-d7c2b13ac84a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76322025-01-13T22:52:49.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4a5d879e-051a-4dd8-8379-d7c2b13ac84a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76332025-01-13T22:52:50.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 698d0980-3fc0-463b-8777-ecc73f58487f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76342025-01-13T22:52:50.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 698d0980-3fc0-463b-8777-ecc73f58487f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76352025-01-13T22:52:50.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 698d0980-3fc0-463b-8777-ecc73f58487f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76362025-01-13T22:52:51.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
76372025-01-13T22:52:51.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
76382025-01-13T22:52:51.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76392025-01-13T22:52:51.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76402025-01-13T22:52:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76412025-01-13T22:52:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76422025-01-13T22:52:51.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76432025-01-13T22:52:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76442025-01-13T22:52:51.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76452025-01-13T22:52:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76462025-01-13T22:52:51.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76472025-01-13T22:52:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76482025-01-13T22:52:51.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76492025-01-13T22:52:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76502025-01-13T22:52:51.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76512025-01-13T22:52:51.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.107698ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76522025-01-13T22:52:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
76532025-01-13T22:52:51.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76542025-01-13T22:52:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76552025-01-13T22:52:51.117ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
76562025-01-13T22:52:51.117ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.299049ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
76572025-01-13T22:52:51.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d8d7cc4-3ebc-4cf3-856e-81d4bf467d81 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76582025-01-13T22:52:51.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d8d7cc4-3ebc-4cf3-856e-81d4bf467d81 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76592025-01-13T22:52:51.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d8d7cc4-3ebc-4cf3-856e-81d4bf467d81 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76602025-01-13T22:52:52.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 721d3c0b-02f3-4acd-9d15-d3fa3650a247 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76612025-01-13T22:52:52.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 721d3c0b-02f3-4acd-9d15-d3fa3650a247 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76622025-01-13T22:52:52.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 721d3c0b-02f3-4acd-9d15-d3fa3650a247 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76632025-01-13T22:52:53.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 793cac10-eef7-4aef-a663-d7c54165bb01 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76642025-01-13T22:52:53.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 793cac10-eef7-4aef-a663-d7c54165bb01 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76652025-01-13T22:52:53.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 793cac10-eef7-4aef-a663-d7c54165bb01 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76662025-01-13T22:52:53.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = e32fe924-c8a3-4d50-8257-ec191f8a1624 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
76672025-01-13T22:52:54.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc8fe64f-8e26-4d02-8837-5d2cb4e9642e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76682025-01-13T22:52:54.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc8fe64f-8e26-4d02-8837-5d2cb4e9642e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76692025-01-13T22:52:54.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cc8fe64f-8e26-4d02-8837-5d2cb4e9642e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76702025-01-13T22:52:55.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dd47e918-343f-446c-be0a-02598d416abc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76712025-01-13T22:52:55.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dd47e918-343f-446c-be0a-02598d416abc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76722025-01-13T22:52:55.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dd47e918-343f-446c-be0a-02598d416abc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76732025-01-13T22:52:56.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bcb27773-8aaa-4e0b-af16-24fa71936f2f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76742025-01-13T22:52:56.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bcb27773-8aaa-4e0b-af16-24fa71936f2f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76752025-01-13T22:52:56.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bcb27773-8aaa-4e0b-af16-24fa71936f2f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76762025-01-13T22:52:57.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d1813e84-250f-4891-a1f7-a50e08c050db roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76772025-01-13T22:52:57.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d1813e84-250f-4891-a1f7-a50e08c050db resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76782025-01-13T22:52:57.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d1813e84-250f-4891-a1f7-a50e08c050db response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76792025-01-13T22:52:58.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ad8f13fd-9f95-4e56-9e3c-8857bea7b344 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76802025-01-13T22:52:58.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ad8f13fd-9f95-4e56-9e3c-8857bea7b344 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76812025-01-13T22:52:58.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ad8f13fd-9f95-4e56-9e3c-8857bea7b344 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76822025-01-13T22:52:59.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 08ab07fa-2fc7-46f8-85a5-4189ac0f52f5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76832025-01-13T22:52:59.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 08ab07fa-2fc7-46f8-85a5-4189ac0f52f5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76842025-01-13T22:52:59.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 08ab07fa-2fc7-46f8-85a5-4189ac0f52f5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76852025-01-13T22:53:00.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94ab6b2a-9f32-4a47-b719-2e0bda1fb86e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76862025-01-13T22:53:00.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94ab6b2a-9f32-4a47-b719-2e0bda1fb86e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76872025-01-13T22:53:00.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 94ab6b2a-9f32-4a47-b719-2e0bda1fb86e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
76882025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
76892025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76902025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
76912025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
76922025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76932025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
76942025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76952025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76962025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
76972025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76982025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
76992025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
77002025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77012025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77022025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
77032025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77042025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
77052025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77062025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77072025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
77082025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
77092025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77102025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
77112025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77122025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
77132025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77142025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
77152025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77162025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
77172025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77182025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
77192025-01-13T22:53:01.068ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77202025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77212025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
77222025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
77232025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77242025-01-13T22:53:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77252025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77262025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77272025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77282025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77292025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77302025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77312025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77322025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77332025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77342025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77352025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77362025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77372025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77382025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77392025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77402025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77412025-01-13T22:53:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77422025-01-13T22:53:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77432025-01-13T22:53:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77442025-01-13T22:53:01.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77452025-01-13T22:53:01.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462025-01-13T22:53:01.072ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.944574ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77472025-01-13T22:53:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77482025-01-13T22:53:01.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77492025-01-13T22:53:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77502025-01-13T22:53:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77512025-01-13T22:53:01.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77522025-01-13T22:53:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77532025-01-13T22:53:01.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77542025-01-13T22:53:01.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3240, tv_nsec: 706633489 } })
77552025-01-13T22:53:01.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3240, tv_nsec: 706958039 } })
77562025-01-13T22:53:01.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77572025-01-13T22:53:01.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77582025-01-13T22:53:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77592025-01-13T22:53:01.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77602025-01-13T22:53:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77612025-01-13T22:53:01.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77622025-01-13T22:53:01.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77632025-01-13T22:53:01.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77642025-01-13T22:53:01.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77652025-01-13T22:53:01.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77662025-01-13T22:53:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77672025-01-13T22:53:01.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77682025-01-13T22:53:01.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77692025-01-13T22:53:01.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77702025-01-13T22:53:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77712025-01-13T22:53:01.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722025-01-13T22:53:01.114ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77732025-01-13T22:53:01.114ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77742025-01-13T22:53:01.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77752025-01-13T22:53:01.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77762025-01-13T22:53:01.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77772025-01-13T22:53:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77782025-01-13T22:53:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77792025-01-13T22:53:01.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77802025-01-13T22:53:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77812025-01-13T22:53:01.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.378554ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
77822025-01-13T22:53:01.119ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3240, tv_nsec: 747233235 } })
77832025-01-13T22:53:01.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
77842025-01-13T22:53:01.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77852025-01-13T22:53:01.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77862025-01-13T22:53:01.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77872025-01-13T22:53:01.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77882025-01-13T22:53:01.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77892025-01-13T22:53:01.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77902025-01-13T22:53:01.125ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77912025-01-13T22:53:01.125ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77922025-01-13T22:53:01.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77932025-01-13T22:53:01.126ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c836162d-28ba-4a95-b71e-92cdcac2b702", "content-length": "26", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
77942025-01-13T22:53:01.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77952025-01-13T22:53:01.127ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77962025-01-13T22:53:01.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77972025-01-13T22:53:01.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.194593ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
77982025-01-13T22:53:01.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77992025-01-13T22:53:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
78002025-01-13T22:53:01.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78012025-01-13T22:53:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78022025-01-13T22:53:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78032025-01-13T22:53:01.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78042025-01-13T22:53:01.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.563688ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78052025-01-13T22:53:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
78062025-01-13T22:53:01.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78072025-01-13T22:53:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78082025-01-13T22:53:01.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78092025-01-13T22:53:01.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78102025-01-13T22:53:01.132ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78112025-01-13T22:53:01.132ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.065905ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78122025-01-13T22:53:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78132025-01-13T22:53:01.133ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78142025-01-13T22:53:01.134ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.413147ms iteration = 20 status = 0
78152025-01-13T22:53:01.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78162025-01-13T22:53:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78172025-01-13T22:53:01.135ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78182025-01-13T22:53:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78192025-01-13T22:53:01.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78202025-01-13T22:53:01.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78212025-01-13T22:53:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78222025-01-13T22:53:01.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78232025-01-13T22:53:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78242025-01-13T22:53:01.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78252025-01-13T22:53:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78262025-01-13T22:53:01.142ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
78272025-01-13T22:53:01.142ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.010008ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
78282025-01-13T22:53:01.155ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78292025-01-13T22:53:01.155ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78302025-01-13T22:53:01.155ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f4bc63-37b5-48c1-ad2a-11def441748f", "content-length": "26", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
78312025-01-13T22:53:01.155ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78322025-01-13T22:53:01.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78332025-01-13T22:53:01.158ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78342025-01-13T22:53:01.158ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78352025-01-13T22:53:01.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78362025-01-13T22:53:01.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78372025-01-13T22:53:01.164ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78382025-01-13T22:53:01.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78392025-01-13T22:53:01.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.171529ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78402025-01-13T22:53:01.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78412025-01-13T22:53:01.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78422025-01-13T22:53:01.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.501135ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78432025-01-13T22:53:01.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.419469ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
78442025-01-13T22:53:01.198ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78452025-01-13T22:53:01.198ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78462025-01-13T22:53:01.198ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.710388ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78472025-01-13T22:53:01.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78482025-01-13T22:53:01.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78492025-01-13T22:53:01.207ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78502025-01-13T22:53:01.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78512025-01-13T22:53:01.209ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78522025-01-13T22:53:01.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78532025-01-13T22:53:01.229ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78542025-01-13T22:53:01.229ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f444987f-75f0-4375-80f0-90499eba94c5", "content-length": "1", "date": "Mon, 13 Jan 2025 22:53:00 GMT"} })
78552025-01-13T22:53:01.230ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78562025-01-13T22:53:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78572025-01-13T22:53:01.232ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 163.998337ms iteration = 20 status = null
78582025-01-13T22:53:01.239ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
78592025-01-13T22:53:01.239ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 170.275704ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
78602025-01-13T22:53:01.245ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.444028ms iteration = 22 status = {"physical_disks_added":0}
78612025-01-13T22:53:01.263ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.65227ms iteration = 20 status = {}
78622025-01-13T22:53:01.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
78632025-01-13T22:53:01.276ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78642025-01-13T22:53:01.276ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ae5f9a0-fb85-408f-9b66-cbc99c37235b", "content-length": "26", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
78652025-01-13T22:53:01.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78662025-01-13T22:53:01.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
78672025-01-13T22:53:01.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78682025-01-13T22:53:01.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78692025-01-13T22:53:01.298ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78702025-01-13T22:53:01.298ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78712025-01-13T22:53:01.299ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "413b8a68-06c5-49e2-9a18-7e3eb33057ad", "content-length": "372", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
78722025-01-13T22:53:01.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78732025-01-13T22:53:01.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78742025-01-13T22:53:01.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78752025-01-13T22:53:01.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78762025-01-13T22:53:01.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78772025-01-13T22:53:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78782025-01-13T22:53:01.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78792025-01-13T22:53:01.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78802025-01-13T22:53:01.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78812025-01-13T22:53:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78822025-01-13T22:53:01.312ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
78832025-01-13T22:53:01.312ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78842025-01-13T22:53:01.312ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "500de1a2-7ecd-44a3-8954-bd0fafa96952", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
78852025-01-13T22:53:01.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78862025-01-13T22:53:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78872025-01-13T22:53:01.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78882025-01-13T22:53:01.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78892025-01-13T22:53:01.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78902025-01-13T22:53:01.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78912025-01-13T22:53:01.321ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78922025-01-13T22:53:01.321ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78932025-01-13T22:53:01.321ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0480e02c-72e1-45d0-a438-683b488fd3e7", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
78942025-01-13T22:53:01.322ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.697207ms iteration = 20 status = {}
78952025-01-13T22:53:01.373ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78962025-01-13T22:53:01.374ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cab26e6-d6ad-4d44-93ed-d26687cfe13e", "content-length": "691", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
78972025-01-13T22:53:01.374ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
78982025-01-13T22:53:01.374ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
78992025-01-13T22:53:01.374ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79002025-01-13T22:53:01.375ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 306.584221ms iteration = 20 status = {}
79012025-01-13T22:53:01.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79022025-01-13T22:53:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79032025-01-13T22:53:01.408ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
79042025-01-13T22:53:01.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79052025-01-13T22:53:01.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79062025-01-13T22:53:01.419ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79072025-01-13T22:53:01.419ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4de7d2a-dba2-41ad-b2db-58a67b66f6f7", "content-length": "134", "date": "Mon, 13 Jan 2025 22:53:00 GMT"} })
79082025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79092025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
79102025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79112025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79122025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79132025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79142025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79152025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79162025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79172025-01-13T22:53:01.419ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79182025-01-13T22:53:01.420ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
79192025-01-13T22:53:01.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79202025-01-13T22:53:01.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79212025-01-13T22:53:01.421ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79222025-01-13T22:53:01.421ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c811b7a9-d0d9-4c6f-b75f-132c0e21bff5", "content-length": "2", "date": "Mon, 13 Jan 2025 22:53:00 GMT"} })
79232025-01-13T22:53:01.421ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79242025-01-13T22:53:01.421ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed69b2c1-4a81-4a02-a8d7-0ed54476155e", "content-length": "51", "date": "Mon, 13 Jan 2025 22:53:00 GMT"} })
79252025-01-13T22:53:01.421ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
79262025-01-13T22:53:01.421ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79272025-01-13T22:53:01.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9dcef87c-abb6-4132-b291-34fce0115f8b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
79282025-01-13T22:53:01.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9dcef87c-abb6-4132-b291-34fce0115f8b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
79292025-01-13T22:53:01.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9dcef87c-abb6-4132-b291-34fce0115f8b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
79302025-01-13T22:53:01.511ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cfbd5fac-1900-4c26-91b7-8a3abc784563", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
79312025-01-13T22:53:01.511ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
79322025-01-13T22:53:01.511ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79332025-01-13T22:53:01.511ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1eff866-d4e5-419e-a4ba-6fbfea630ae4", "content-length": "682", "date": "Mon, 13 Jan 2025 22:53:01 GMT"} })
79342025-01-13T22:53:01.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79352025-01-13T22:53:01.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79362025-01-13T22:53:01.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79372025-01-13T22:53:01.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79382025-01-13T22:53:01.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79392025-01-13T22:53:01.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79402025-01-13T22:53:01.521ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79412025-01-13T22:53:01.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79422025-01-13T22:53:01.528ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 459.381295ms iteration = 20 status = {}
79432025-01-13T22:53:01.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c35e237-6c85-41ee-b835-bc472a4dc685 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79442025-01-13T22:53:01.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c35e237-6c85-41ee-b835-bc472a4dc685 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79452025-01-13T22:53:01.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c35e237-6c85-41ee-b835-bc472a4dc685 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79462025-01-13T22:53:02.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 52c504d1-d35b-46ab-9c19-ed8d51cd7c57 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79472025-01-13T22:53:02.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 52c504d1-d35b-46ab-9c19-ed8d51cd7c57 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79482025-01-13T22:53:02.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 52c504d1-d35b-46ab-9c19-ed8d51cd7c57 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79492025-01-13T22:53:03.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 31a03410-daaf-4366-912a-af1bb4b93619 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
79502025-01-13T22:53:03.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba8efebf-3d3b-4d28-ab7d-9e7b82dded70 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79512025-01-13T22:53:03.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba8efebf-3d3b-4d28-ab7d-9e7b82dded70 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79522025-01-13T22:53:03.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba8efebf-3d3b-4d28-ab7d-9e7b82dded70 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79532025-01-13T22:53:04.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb1c5619-aea5-4915-8b34-8c89e369c98d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79542025-01-13T22:53:04.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb1c5619-aea5-4915-8b34-8c89e369c98d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79552025-01-13T22:53:04.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cb1c5619-aea5-4915-8b34-8c89e369c98d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79562025-01-13T22:53:05.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43b3e584-5791-4657-a59b-7e89ea570355 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79572025-01-13T22:53:05.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43b3e584-5791-4657-a59b-7e89ea570355 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79582025-01-13T22:53:05.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43b3e584-5791-4657-a59b-7e89ea570355 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79592025-01-13T22:53:06.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 99eec5b1-1d75-4aba-a2a4-d3db6001ed67 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79602025-01-13T22:53:06.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 99eec5b1-1d75-4aba-a2a4-d3db6001ed67 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79612025-01-13T22:53:06.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 99eec5b1-1d75-4aba-a2a4-d3db6001ed67 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79622025-01-13T22:53:07.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b805919-f94d-4944-aceb-ba4681f1cbe4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79632025-01-13T22:53:07.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b805919-f94d-4944-aceb-ba4681f1cbe4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79642025-01-13T22:53:07.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1b805919-f94d-4944-aceb-ba4681f1cbe4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79652025-01-13T22:53:08.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5bbc9ce2-ed89-4c1d-b0fd-f1e8c46ad00c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79662025-01-13T22:53:08.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5bbc9ce2-ed89-4c1d-b0fd-f1e8c46ad00c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79672025-01-13T22:53:08.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5bbc9ce2-ed89-4c1d-b0fd-f1e8c46ad00c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79682025-01-13T22:53:09.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 449745a6-b8a3-46da-a9ae-9591f0d88843 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79692025-01-13T22:53:09.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 449745a6-b8a3-46da-a9ae-9591f0d88843 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79702025-01-13T22:53:09.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 449745a6-b8a3-46da-a9ae-9591f0d88843 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79712025-01-13T22:53:10.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 904e2e43-e5b3-4b81-aa56-f977f83a839f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79722025-01-13T22:53:10.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 904e2e43-e5b3-4b81-aa56-f977f83a839f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79732025-01-13T22:53:10.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 904e2e43-e5b3-4b81-aa56-f977f83a839f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79742025-01-13T22:53:11.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
79752025-01-13T22:53:11.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
79762025-01-13T22:53:11.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79772025-01-13T22:53:11.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79782025-01-13T22:53:11.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79792025-01-13T22:53:11.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79802025-01-13T22:53:11.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79812025-01-13T22:53:11.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79822025-01-13T22:53:11.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79832025-01-13T22:53:11.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.416408ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79842025-01-13T22:53:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79852025-01-13T22:53:11.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79862025-01-13T22:53:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79872025-01-13T22:53:11.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79882025-01-13T22:53:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79892025-01-13T22:53:11.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79902025-01-13T22:53:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
79912025-01-13T22:53:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79922025-01-13T22:53:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79932025-01-13T22:53:11.090ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
79942025-01-13T22:53:11.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.977831ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
79952025-01-13T22:53:11.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8480c65c-16a9-4e9e-ba1a-f35a3bb7e453 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79962025-01-13T22:53:11.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8480c65c-16a9-4e9e-ba1a-f35a3bb7e453 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79972025-01-13T22:53:11.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8480c65c-16a9-4e9e-ba1a-f35a3bb7e453 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79982025-01-13T22:53:12.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f4b3e05c-fe16-46ef-bb74-a58793c958b6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
79992025-01-13T22:53:12.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f4b3e05c-fe16-46ef-bb74-a58793c958b6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80002025-01-13T22:53:12.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f4b3e05c-fe16-46ef-bb74-a58793c958b6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80012025-01-13T22:53:13.508ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = c92c15b7-40d3-4ed1-88bd-4d23fb5ca22f response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
80022025-01-13T22:53:13.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f81da67-9533-4ac0-a82f-fe84fd24931f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80032025-01-13T22:53:13.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f81da67-9533-4ac0-a82f-fe84fd24931f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80042025-01-13T22:53:13.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f81da67-9533-4ac0-a82f-fe84fd24931f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80052025-01-13T22:53:14.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4b7efce0-24aa-4a5f-9e19-0359cd27eeb0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80062025-01-13T22:53:14.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4b7efce0-24aa-4a5f-9e19-0359cd27eeb0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80072025-01-13T22:53:14.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4b7efce0-24aa-4a5f-9e19-0359cd27eeb0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80082025-01-13T22:53:15.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70ac58f9-1d08-410c-8c44-d73e646388e1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80092025-01-13T22:53:15.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70ac58f9-1d08-410c-8c44-d73e646388e1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80102025-01-13T22:53:15.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 70ac58f9-1d08-410c-8c44-d73e646388e1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80112025-01-13T22:53:16.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 186765f6-10fe-4eed-ae60-ae31de7b6c91 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80122025-01-13T22:53:16.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 186765f6-10fe-4eed-ae60-ae31de7b6c91 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80132025-01-13T22:53:16.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 186765f6-10fe-4eed-ae60-ae31de7b6c91 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80142025-01-13T22:53:17.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d76fbf0-6657-432e-89bf-36368ae1976b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80152025-01-13T22:53:17.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d76fbf0-6657-432e-89bf-36368ae1976b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80162025-01-13T22:53:17.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d76fbf0-6657-432e-89bf-36368ae1976b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80172025-01-13T22:53:18.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a0a386c-1aba-4a59-bdd0-99af45a18dd5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80182025-01-13T22:53:18.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a0a386c-1aba-4a59-bdd0-99af45a18dd5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80192025-01-13T22:53:18.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a0a386c-1aba-4a59-bdd0-99af45a18dd5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80202025-01-13T22:53:20.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3158d21-2050-4230-9b8d-0407c6e33f8d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80212025-01-13T22:53:20.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3158d21-2050-4230-9b8d-0407c6e33f8d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80222025-01-13T22:53:20.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f3158d21-2050-4230-9b8d-0407c6e33f8d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80232025-01-13T22:53:21.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1e468e59-2cab-4b1a-925a-cb83df644550 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80242025-01-13T22:53:21.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1e468e59-2cab-4b1a-925a-cb83df644550 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80252025-01-13T22:53:21.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1e468e59-2cab-4b1a-925a-cb83df644550 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80262025-01-13T22:53:21.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
80272025-01-13T22:53:21.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80282025-01-13T22:53:21.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
80292025-01-13T22:53:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80302025-01-13T22:53:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80312025-01-13T22:53:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80322025-01-13T22:53:21.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80332025-01-13T22:53:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80342025-01-13T22:53:21.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80352025-01-13T22:53:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80362025-01-13T22:53:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80372025-01-13T22:53:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80382025-01-13T22:53:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80392025-01-13T22:53:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
80402025-01-13T22:53:21.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80412025-01-13T22:53:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80422025-01-13T22:53:21.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
80432025-01-13T22:53:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.097151ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
80442025-01-13T22:53:21.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80452025-01-13T22:53:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80462025-01-13T22:53:21.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.739568ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80472025-01-13T22:53:22.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6eb88fc6-6ecb-4064-b957-847ce4a6071e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80482025-01-13T22:53:22.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6eb88fc6-6ecb-4064-b957-847ce4a6071e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80492025-01-13T22:53:22.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6eb88fc6-6ecb-4064-b957-847ce4a6071e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80502025-01-13T22:53:23.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a9fb7c94-e8cf-4167-bdb2-59caf5e3ac48 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80512025-01-13T22:53:23.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a9fb7c94-e8cf-4167-bdb2-59caf5e3ac48 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80522025-01-13T22:53:23.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a9fb7c94-e8cf-4167-bdb2-59caf5e3ac48 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80532025-01-13T22:53:23.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 79255427-4634-4235-b52c-2a85b1d94591 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
80542025-01-13T22:53:24.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e15c25ce-ea16-450f-9b24-6d7093799e2b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80552025-01-13T22:53:24.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e15c25ce-ea16-450f-9b24-6d7093799e2b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80562025-01-13T22:53:24.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e15c25ce-ea16-450f-9b24-6d7093799e2b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80572025-01-13T22:53:25.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d3c51097-afd7-4d82-9256-c415a16b8706 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80582025-01-13T22:53:25.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d3c51097-afd7-4d82-9256-c415a16b8706 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80592025-01-13T22:53:25.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d3c51097-afd7-4d82-9256-c415a16b8706 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80602025-01-13T22:53:26.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c0987fa-4363-4690-93b6-93136692dc58 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80612025-01-13T22:53:26.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c0987fa-4363-4690-93b6-93136692dc58 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80622025-01-13T22:53:26.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c0987fa-4363-4690-93b6-93136692dc58 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80632025-01-13T22:53:27.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ed8bddb1-a982-4995-9064-30796e0df2b9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80642025-01-13T22:53:27.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ed8bddb1-a982-4995-9064-30796e0df2b9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80652025-01-13T22:53:27.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ed8bddb1-a982-4995-9064-30796e0df2b9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80662025-01-13T22:53:28.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e01336bd-79b3-4a58-8715-113b0e5f11c9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80672025-01-13T22:53:28.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e01336bd-79b3-4a58-8715-113b0e5f11c9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80682025-01-13T22:53:28.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e01336bd-79b3-4a58-8715-113b0e5f11c9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80692025-01-13T22:53:28.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 4965970b-e249-4b28-9974-ba2eae3b3127 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
80702025-01-13T22:53:28.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 4965970b-e249-4b28-9974-ba2eae3b3127 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
80712025-01-13T22:53:28.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 4965970b-e249-4b28-9974-ba2eae3b3127 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
80722025-01-13T22:53:28.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 17af44af-777f-4a7d-b8a4-32f6ceb80335 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
80732025-01-13T22:53:28.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 17af44af-777f-4a7d-b8a4-32f6ceb80335 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
80742025-01-13T22:53:28.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 17af44af-777f-4a7d-b8a4-32f6ceb80335 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
80752025-01-13T22:53:29.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d2378deb-4239-48ff-afa6-b9decd422312 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80762025-01-13T22:53:29.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d2378deb-4239-48ff-afa6-b9decd422312 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80772025-01-13T22:53:29.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d2378deb-4239-48ff-afa6-b9decd422312 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80782025-01-13T22:53:30.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 654f68d2-09ee-4d9d-9236-d96ac4cf998d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80792025-01-13T22:53:30.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 654f68d2-09ee-4d9d-9236-d96ac4cf998d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80802025-01-13T22:53:30.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 654f68d2-09ee-4d9d-9236-d96ac4cf998d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
80812025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
80822025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
80832025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80842025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
80852025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
80862025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
80872025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
80882025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
80892025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80902025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80912025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80922025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
80932025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
80942025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80952025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80962025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
80972025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80982025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
80992025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81002025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81012025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81022025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
81032025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
81042025-01-13T22:53:31.067ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
81052025-01-13T22:53:31.067ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
81062025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81072025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
81082025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81092025-01-13T22:53:31.067ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3270, tv_nsec: 695574721 } })
81102025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
81112025-01-13T22:53:31.067ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3270, tv_nsec: 695578861 } })
81122025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
81132025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81142025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
81152025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81162025-01-13T22:53:31.067ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81172025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81182025-01-13T22:53:31.067ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
81192025-01-13T22:53:31.067ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:43:31.067915048 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
81202025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
81212025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
81222025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81232025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
81242025-01-13T22:53:31.068ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
81252025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81262025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
81272025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81282025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
81292025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81302025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
81312025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
81322025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
81332025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
81342025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
81352025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81362025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
81372025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81382025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81392025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
81402025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81412025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
81422025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81432025-01-13T22:53:31.068ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
81442025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
81452025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
81462025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.371\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
81472025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81482025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81492025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
81502025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
81512025-01-13T22:53:31.068ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
81522025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
81532025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81542025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
81552025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81562025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
81572025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
81582025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81592025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81602025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81612025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81622025-01-13T22:53:31.068ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
81632025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81642025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81652025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81662025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81672025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
81682025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81692025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81702025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81712025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81722025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
81732025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81742025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
81752025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81762025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.391754ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
81772025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81782025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81792025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81802025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81812025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81822025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
81832025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.408904ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
81842025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81852025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81862025-01-13T22:53:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
81872025-01-13T22:53:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81882025-01-13T22:53:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81892025-01-13T22:53:31.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81902025-01-13T22:53:31.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81912025-01-13T22:53:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81922025-01-13T22:53:31.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
81932025-01-13T22:53:31.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81942025-01-13T22:53:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81952025-01-13T22:53:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.700659ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81962025-01-13T22:53:31.073ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81972025-01-13T22:53:31.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81982025-01-13T22:53:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
81992025-01-13T22:53:31.075ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82002025-01-13T22:53:31.075ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82012025-01-13T22:53:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82022025-01-13T22:53:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82032025-01-13T22:53:31.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82042025-01-13T22:53:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
82052025-01-13T22:53:31.077ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82062025-01-13T22:53:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82072025-01-13T22:53:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82082025-01-13T22:53:31.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82092025-01-13T22:53:31.078ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.351655ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
82102025-01-13T22:53:31.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82112025-01-13T22:53:31.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82122025-01-13T22:53:31.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3270, tv_nsec: 707512766 } })
82132025-01-13T22:53:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82142025-01-13T22:53:31.080ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
82152025-01-13T22:53:31.080ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:43:31.067915048 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
82162025-01-13T22:53:31.080ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.065691ms iteration = 11 status = {"expiration":"2025-01-13T22:43:31.067915048Z","pruned":[]}
82172025-01-13T22:53:31.081ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182025-01-13T22:53:31.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3270, tv_nsec: 710743608 } })
82192025-01-13T22:53:31.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
82202025-01-13T22:53:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
82212025-01-13T22:53:31.083ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82222025-01-13T22:53:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82232025-01-13T22:53:31.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82242025-01-13T22:53:31.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82252025-01-13T22:53:31.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82262025-01-13T22:53:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82272025-01-13T22:53:31.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82282025-01-13T22:53:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82292025-01-13T22:53:31.090ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82302025-01-13T22:53:31.090ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82312025-01-13T22:53:31.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82322025-01-13T22:53:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82332025-01-13T22:53:31.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82342025-01-13T22:53:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82352025-01-13T22:53:31.095ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(600bc615-1852-4706-9c7c-47e0973b3f6c, 0), (8734413e-bf28-4f46-94fd-3f11a7dfcd3f, 0), (37f47f6b-763f-4df9-9496-e96c480c2818, 0)]
82362025-01-13T22:53:31.096ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3270, tv_nsec: 724068377 } })
82372025-01-13T22:53:31.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82382025-01-13T22:53:31.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82392025-01-13T22:53:31.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82402025-01-13T22:53:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82412025-01-13T22:53:31.103ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82422025-01-13T22:53:31.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 35.931381ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82432025-01-13T22:53:31.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82442025-01-13T22:53:31.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82452025-01-13T22:53:31.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82462025-01-13T22:53:31.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82472025-01-13T22:53:31.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82482025-01-13T22:53:31.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.557093ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
82492025-01-13T22:53:31.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502025-01-13T22:53:31.120ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
82512025-01-13T22:53:31.120ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 53.017837ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
82522025-01-13T22:53:31.121ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82532025-01-13T22:53:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82542025-01-13T22:53:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82552025-01-13T22:53:31.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82562025-01-13T22:53:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82572025-01-13T22:53:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82582025-01-13T22:53:31.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82592025-01-13T22:53:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82602025-01-13T22:53:31.127ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82612025-01-13T22:53:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82622025-01-13T22:53:31.127ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82632025-01-13T22:53:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82642025-01-13T22:53:31.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82652025-01-13T22:53:31.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82662025-01-13T22:53:31.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82672025-01-13T22:53:31.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82682025-01-13T22:53:31.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82692025-01-13T22:53:31.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82702025-01-13T22:53:31.132ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82712025-01-13T22:53:31.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82722025-01-13T22:53:31.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82732025-01-13T22:53:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82742025-01-13T22:53:31.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752025-01-13T22:53:31.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82762025-01-13T22:53:31.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.299889ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
82772025-01-13T22:53:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82782025-01-13T22:53:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82792025-01-13T22:53:31.142ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82802025-01-13T22:53:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82812025-01-13T22:53:31.142ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82822025-01-13T22:53:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82832025-01-13T22:53:31.143ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
82842025-01-13T22:53:31.143ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
82852025-01-13T22:53:31.144ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.906617ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
82862025-01-13T22:53:31.151ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
82872025-01-13T22:53:31.151ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
82882025-01-13T22:53:31.151ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.123924ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
82892025-01-13T22:53:31.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82902025-01-13T22:53:31.164ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82912025-01-13T22:53:31.164ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82922025-01-13T22:53:31.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82932025-01-13T22:53:31.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82942025-01-13T22:53:31.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
82952025-01-13T22:53:31.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82962025-01-13T22:53:31.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82972025-01-13T22:53:31.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82982025-01-13T22:53:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82992025-01-13T22:53:31.169ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
83002025-01-13T22:53:31.169ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
83012025-01-13T22:53:31.169ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
83022025-01-13T22:53:31.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83032025-01-13T22:53:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83042025-01-13T22:53:31.173ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
83052025-01-13T22:53:31.173ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
83062025-01-13T22:53:31.173ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
83072025-01-13T22:53:31.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83082025-01-13T22:53:31.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83092025-01-13T22:53:31.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83102025-01-13T22:53:31.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83112025-01-13T22:53:31.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
83122025-01-13T22:53:31.218ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83132025-01-13T22:53:31.239ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83142025-01-13T22:53:31.239ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83152025-01-13T22:53:31.239ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94d64f5e-ee59-4dac-bc4d-547d5764fbe4", "content-length": "26", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83162025-01-13T22:53:31.239ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83172025-01-13T22:53:31.241ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83182025-01-13T22:53:31.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8ae34719-7afb-4c66-8b04-6a33d8624d71 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
83192025-01-13T22:53:31.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8ae34719-7afb-4c66-8b04-6a33d8624d71 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
83202025-01-13T22:53:31.254ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
83212025-01-13T22:53:31.254ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
83222025-01-13T22:53:31.254ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
83232025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "30cbb9ee-42b6-4c9a-ade6-549bf0fc1000", "content-length": "476", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83242025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
83252025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b524ed1-c786-4fe7-9471-1c8eb222fb8e", "content-length": "734", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83262025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
83272025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c66f9c38-8883-48c3-8000-6fdbd559f721", "content-length": "111", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83282025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
83292025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "edf80f7b-855e-4ba1-ae50-119cf76b4f78", "content-length": "111", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83302025-01-13T22:53:31.255ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
83312025-01-13T22:53:31.256ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed3d958e-f231-4732-911c-03d8f77af393", "content-length": "167", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83322025-01-13T22:53:31.256ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
83332025-01-13T22:53:31.256ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f320f60-2741-4404-8feb-97e20ed77a02", "content-length": "167", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83342025-01-13T22:53:31.256ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
83352025-01-13T22:53:31.256ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "22db0b1a-0e1f-4ae0-87cb-5658e1e69030", "content-length": "175", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83362025-01-13T22:53:31.256ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
83372025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba287c2-bf99-44d1-b108-8aa7d86754e0", "content-length": "175", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83382025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
83392025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "33590854-6f78-4642-a353-6e74f65bb0c4", "content-length": "702", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83402025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
83412025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "36c67800-fa5c-4139-a323-3aa87b850e16", "content-length": "727", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83422025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
83432025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab5fa6f7-614d-4803-9893-03484d6ec236", "content-length": "729", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83442025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
83452025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b893e13-0364-4cc2-b0c0-e91698c5c844", "content-length": "728", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83462025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
83472025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c76ccd86-2f4f-401d-9007-719b6867ada8", "content-length": "722", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83482025-01-13T22:53:31.257ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
83492025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "204ff587-595b-4555-a5f5-2c119df6a819", "content-length": "109", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83502025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
83512025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f642201e-5293-4747-a2fe-9d15d1f99e6b", "content-length": "109", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83522025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
83532025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "80aba4ac-4936-4256-baa9-16c788adcc56", "content-length": "169", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83542025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
83552025-01-13T22:53:31.258ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "268c66d1-1f94-420a-8e58-6805fc973a93", "content-length": "169", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83562025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
83572025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f675f7d-3c43-4987-a860-b971f1edb4ed", "content-length": "178", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83582025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
83592025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dd6cb27-fe36-40d4-a213-1a000a49f1c2", "content-length": "178", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83602025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
83612025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6a94bd3-b74f-4401-971b-2641669d524d", "content-length": "702", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83622025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
83632025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5350f5ef-6eef-40d1-9acd-793a8fd9ce96", "content-length": "727", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83642025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
83652025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40ea43bc-9cc4-47c8-b05c-c52c683b2827", "content-length": "729", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83662025-01-13T22:53:31.259ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
83672025-01-13T22:53:31.260ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e325661-5b84-4c27-8b3b-5cc78f052288", "content-length": "728", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83682025-01-13T22:53:31.260ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83692025-01-13T22:53:31.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83702025-01-13T22:53:31.261ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83712025-01-13T22:53:31.261ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83722025-01-13T22:53:31.261ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7231ba0e-7e6e-4471-82d1-b15f9141ccc8", "content-length": "26", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
83732025-01-13T22:53:31.261ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83742025-01-13T22:53:31.263ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83752025-01-13T22:53:31.315ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83762025-01-13T22:53:31.315ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83772025-01-13T22:53:31.316ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dca3407-0b74-426b-aad6-e54575f5e754", "content-length": "372", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
83782025-01-13T22:53:31.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83792025-01-13T22:53:31.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83802025-01-13T22:53:31.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83812025-01-13T22:53:31.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83822025-01-13T22:53:31.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83832025-01-13T22:53:31.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83842025-01-13T22:53:31.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 251.57742ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83852025-01-13T22:53:31.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3270, tv_nsec: 949242518 } })
83862025-01-13T22:53:31.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
83872025-01-13T22:53:31.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83882025-01-13T22:53:31.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83892025-01-13T22:53:31.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8ae34719-7afb-4c66-8b04-6a33d8624d71 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
83902025-01-13T22:53:31.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83912025-01-13T22:53:31.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83922025-01-13T22:53:31.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83932025-01-13T22:53:31.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83942025-01-13T22:53:31.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83952025-01-13T22:53:31.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83962025-01-13T22:53:31.348ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
83972025-01-13T22:53:31.348ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 279.994735ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
83982025-01-13T22:53:31.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 299.312541ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83992025-01-13T22:53:31.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84002025-01-13T22:53:31.368ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84012025-01-13T22:53:31.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84022025-01-13T22:53:31.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84032025-01-13T22:53:31.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84042025-01-13T22:53:31.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84052025-01-13T22:53:31.371ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84062025-01-13T22:53:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84072025-01-13T22:53:31.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 304.522915ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84082025-01-13T22:53:31.372ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84092025-01-13T22:53:31.372ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84102025-01-13T22:53:31.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 304.635639ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84112025-01-13T22:53:31.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84122025-01-13T22:53:31.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84132025-01-13T22:53:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84142025-01-13T22:53:31.374ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84152025-01-13T22:53:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84162025-01-13T22:53:31.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84172025-01-13T22:53:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84182025-01-13T22:53:31.376ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84192025-01-13T22:53:31.376ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84202025-01-13T22:53:31.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212025-01-13T22:53:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84222025-01-13T22:53:31.378ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84232025-01-13T22:53:31.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d006cc6d-0eff-4557-8bc7-b099d09b35d3", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84242025-01-13T22:53:31.379ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84252025-01-13T22:53:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
84262025-01-13T22:53:31.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84272025-01-13T22:53:31.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84282025-01-13T22:53:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84292025-01-13T22:53:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84302025-01-13T22:53:31.381ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f2c1f701-91a9-4b5e-a844-ab2cb0f8ab4d", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84312025-01-13T22:53:31.381ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84322025-01-13T22:53:31.383ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332025-01-13T22:53:31.383ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84342025-01-13T22:53:31.383ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 316.389768ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
84352025-01-13T22:53:31.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84362025-01-13T22:53:31.384ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84372025-01-13T22:53:31.384ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84382025-01-13T22:53:31.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84392025-01-13T22:53:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84402025-01-13T22:53:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84412025-01-13T22:53:31.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422025-01-13T22:53:31.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
84432025-01-13T22:53:31.385ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84442025-01-13T22:53:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84452025-01-13T22:53:31.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84462025-01-13T22:53:31.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84472025-01-13T22:53:31.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84482025-01-13T22:53:31.387ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84492025-01-13T22:53:31.388ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84502025-01-13T22:53:31.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
84512025-01-13T22:53:31.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84522025-01-13T22:53:31.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84532025-01-13T22:53:31.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84542025-01-13T22:53:31.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
84552025-01-13T22:53:31.390ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84562025-01-13T22:53:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
84572025-01-13T22:53:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84582025-01-13T22:53:31.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84592025-01-13T22:53:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84602025-01-13T22:53:31.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84612025-01-13T22:53:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84622025-01-13T22:53:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84632025-01-13T22:53:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
84642025-01-13T22:53:31.394ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84652025-01-13T22:53:31.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
84662025-01-13T22:53:31.394ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84672025-01-13T22:53:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84682025-01-13T22:53:31.394ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9fac61a6-bf5e-4890-92bd-89438d5ea86a", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
84692025-01-13T22:53:31.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84702025-01-13T22:53:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84712025-01-13T22:53:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 328.612053ms iteration = 21 status = 0
84722025-01-13T22:53:31.396ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84732025-01-13T22:53:31.396ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
84742025-01-13T22:53:31.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84752025-01-13T22:53:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84762025-01-13T22:53:31.398ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
84772025-01-13T22:53:31.398ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
84782025-01-13T22:53:31.398ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
84792025-01-13T22:53:31.398ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 331.283228ms iteration = 11 status = {"generation":1}
84802025-01-13T22:53:31.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812025-01-13T22:53:31.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84822025-01-13T22:53:31.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84832025-01-13T22:53:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84842025-01-13T22:53:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84852025-01-13T22:53:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84862025-01-13T22:53:31.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84872025-01-13T22:53:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84882025-01-13T22:53:31.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84892025-01-13T22:53:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84902025-01-13T22:53:31.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84912025-01-13T22:53:31.404ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
84922025-01-13T22:53:31.404ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
84932025-01-13T22:53:31.404ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
84942025-01-13T22:53:31.404ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 337.400289ms iteration = 11 status = {"generation":2}
84952025-01-13T22:53:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84962025-01-13T22:53:31.405ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84972025-01-13T22:53:31.406ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7623d21-f516-4641-a193-c393537a5028", "content-length": "1", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
84982025-01-13T22:53:31.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84992025-01-13T22:53:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85002025-01-13T22:53:31.406ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85012025-01-13T22:53:31.406ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85022025-01-13T22:53:31.407ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85032025-01-13T22:53:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85042025-01-13T22:53:31.409ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
85052025-01-13T22:53:31.409ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 341.299832ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
85062025-01-13T22:53:31.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85072025-01-13T22:53:31.409ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "82926a90-6ce6-4f4a-825c-e99c9bd9f92d", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
85082025-01-13T22:53:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85092025-01-13T22:53:31.410ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 342.161739ms iteration = 21 status = null
85102025-01-13T22:53:31.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85112025-01-13T22:53:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85122025-01-13T22:53:31.411ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 343.716198ms iteration = 21 status = {}
85132025-01-13T22:53:31.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85142025-01-13T22:53:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85152025-01-13T22:53:31.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 346.405223ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
85162025-01-13T22:53:31.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85172025-01-13T22:53:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
85182025-01-13T22:53:31.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85192025-01-13T22:53:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85202025-01-13T22:53:31.419ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85212025-01-13T22:53:31.421ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 353.300839ms iteration = 21 status = {}
85222025-01-13T22:53:31.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85232025-01-13T22:53:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85242025-01-13T22:53:31.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85252025-01-13T22:53:31.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85262025-01-13T22:53:31.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85272025-01-13T22:53:31.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85282025-01-13T22:53:31.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85292025-01-13T22:53:31.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85302025-01-13T22:53:31.434ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
85312025-01-13T22:53:31.434ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 367.126584ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85322025-01-13T22:53:31.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85332025-01-13T22:53:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85342025-01-13T22:53:31.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85352025-01-13T22:53:31.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85362025-01-13T22:53:31.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85372025-01-13T22:53:31.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
85382025-01-13T22:53:31.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85392025-01-13T22:53:31.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85402025-01-13T22:53:31.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85412025-01-13T22:53:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85422025-01-13T22:53:31.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85432025-01-13T22:53:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85442025-01-13T22:53:31.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452025-01-13T22:53:31.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
85462025-01-13T22:53:31.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85472025-01-13T22:53:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85482025-01-13T22:53:31.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85492025-01-13T22:53:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85502025-01-13T22:53:31.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85512025-01-13T22:53:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85522025-01-13T22:53:31.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85532025-01-13T22:53:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85542025-01-13T22:53:31.465ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
85552025-01-13T22:53:31.465ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 397.802128ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
85562025-01-13T22:53:31.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85572025-01-13T22:53:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85582025-01-13T22:53:31.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d2dd0baf-0418-4ea8-9de2-a182b1efaf2f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
85592025-01-13T22:53:31.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d2dd0baf-0418-4ea8-9de2-a182b1efaf2f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
85602025-01-13T22:53:31.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85612025-01-13T22:53:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85622025-01-13T22:53:31.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d2dd0baf-0418-4ea8-9de2-a182b1efaf2f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
85632025-01-13T22:53:31.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85642025-01-13T22:53:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85652025-01-13T22:53:31.475ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
85662025-01-13T22:53:31.475ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85672025-01-13T22:53:31.475ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af1f663c-d06e-4b69-8c5d-90f3db6d5d4b", "content-length": "26", "date": "Mon, 13 Jan 2025 22:53:30 GMT"} })
85682025-01-13T22:53:31.475ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85692025-01-13T22:53:31.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85702025-01-13T22:53:31.477ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
85712025-01-13T22:53:31.478ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85722025-01-13T22:53:31.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85732025-01-13T22:53:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85742025-01-13T22:53:31.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85752025-01-13T22:53:31.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85762025-01-13T22:53:31.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85772025-01-13T22:53:31.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85782025-01-13T22:53:31.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85792025-01-13T22:53:31.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85802025-01-13T22:53:31.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85812025-01-13T22:53:31.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85822025-01-13T22:53:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85832025-01-13T22:53:31.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
85842025-01-13T22:53:31.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85852025-01-13T22:53:31.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85862025-01-13T22:53:31.519ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 452.136968ms iteration = 23 status = {"physical_disks_added":0}
85872025-01-13T22:53:31.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85882025-01-13T22:53:31.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9dacd877-4d6d-4f23-98d4-d6f7623d70cb", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85892025-01-13T22:53:31.576ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85902025-01-13T22:53:31.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "244b1378-8f7e-4903-9e7e-afac3d454c82", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85912025-01-13T22:53:31.579ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85922025-01-13T22:53:31.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fdb786b7-6e35-45ae-a7ec-0cdf464ae0a9", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85932025-01-13T22:53:31.581ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85942025-01-13T22:53:31.584ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
85952025-01-13T22:53:31.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 516.728099ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85962025-01-13T22:53:31.592ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
85972025-01-13T22:53:31.592ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
85982025-01-13T22:53:31.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85992025-01-13T22:53:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86002025-01-13T22:53:31.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86012025-01-13T22:53:31.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86022025-01-13T22:53:31.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86032025-01-13T22:53:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86042025-01-13T22:53:31.649ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
86052025-01-13T22:53:31.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86062025-01-13T22:53:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86072025-01-13T22:53:31.668ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86082025-01-13T22:53:31.669ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3caf8ec-770d-4d99-9ddc-c510dd10b613", "content-length": "134", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86092025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86102025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
86112025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86122025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86132025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86142025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86152025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86162025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86172025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86182025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86192025-01-13T22:53:31.669ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
86202025-01-13T22:53:31.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86212025-01-13T22:53:31.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86222025-01-13T22:53:31.671ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86232025-01-13T22:53:31.672ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b43b13a3-bf32-4bd3-bcfa-748988321325", "content-length": "2", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86242025-01-13T22:53:31.672ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86252025-01-13T22:53:31.672ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "344c9983-a70f-4320-9d83-479e4a0c5ce1", "content-length": "51", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86262025-01-13T22:53:31.672ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
86272025-01-13T22:53:31.672ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86282025-01-13T22:53:31.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86292025-01-13T22:53:31.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
86302025-01-13T22:53:31.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86312025-01-13T22:53:31.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86322025-01-13T22:53:31.704ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86332025-01-13T22:53:31.711ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
86342025-01-13T22:53:31.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86352025-01-13T22:53:31.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86362025-01-13T22:53:31.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86372025-01-13T22:53:31.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
86382025-01-13T22:53:31.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86392025-01-13T22:53:31.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86402025-01-13T22:53:31.716ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
86412025-01-13T22:53:31.716ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
86422025-01-13T22:53:31.716ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
86432025-01-13T22:53:31.722ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59299548-49a8-4d28-87fa-b496d79aa101", "content-length": "691", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86442025-01-13T22:53:31.722ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
86452025-01-13T22:53:31.722ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
86462025-01-13T22:53:31.722ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
86472025-01-13T22:53:31.724ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 656.125102ms iteration = 21 status = {}
86482025-01-13T22:53:31.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a4ea6558-a8d3-478b-9dfb-82aea6f292e3", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86492025-01-13T22:53:31.776ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
86502025-01-13T22:53:31.776ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86512025-01-13T22:53:31.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "26ddd979-0219-4abe-bfb0-230848d53d1c", "content-length": "682", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86522025-01-13T22:53:31.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86532025-01-13T22:53:31.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86542025-01-13T22:53:31.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86552025-01-13T22:53:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86562025-01-13T22:53:31.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86572025-01-13T22:53:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86582025-01-13T22:53:31.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86592025-01-13T22:53:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86602025-01-13T22:53:31.796ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 728.827838ms iteration = 21 status = {}
86612025-01-13T22:53:31.825ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: bd8d50a3-f530-430e-8ded-11b6657cae3b, time_created: 2025-01-13T22:44:11.739186Z, time_modified: 2025-01-13T22:44:11.739186Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
86622025-01-13T22:53:31.825ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
86632025-01-13T22:53:31.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86642025-01-13T22:53:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86652025-01-13T22:53:31.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86662025-01-13T22:53:31.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86672025-01-13T22:53:31.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86682025-01-13T22:53:31.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
86692025-01-13T22:53:31.838ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "487aa0dc-d190-40fd-a01b-3a3fba3d1267", "content-length": "30797", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86702025-01-13T22:53:31.840ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
86712025-01-13T22:53:31.840ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
86722025-01-13T22:53:31.840ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
86732025-01-13T22:53:31.842ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86742025-01-13T22:53:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86752025-01-13T22:53:31.843ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86762025-01-13T22:53:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
86772025-01-13T22:53:31.845ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86782025-01-13T22:53:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86792025-01-13T22:53:31.862ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
86802025-01-13T22:53:31.863ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "863a9cdc-db35-4be9-9f7e-04dfabd222a6", "date": "Mon, 13 Jan 2025 22:53:31 GMT"} })
86812025-01-13T22:53:31.865ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
86822025-01-13T22:53:31.865ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 797.019673ms
86832025-01-13T22:53:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 797.029023ms iteration = 3 status = {}
86842025-01-13T22:53:32.003ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 5bb2620d-9ee2-4256-ae11-7b0a13c43010 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
86852025-01-13T22:53:32.003ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 5bb2620d-9ee2-4256-ae11-7b0a13c43010 time_started = 2025-01-13 22:53:31.254618 UTC
86862025-01-13T22:53:32.003ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 935.285501ms iteration = 3 status = {"collection_id":"5bb2620d-9ee2-4256-ae11-7b0a13c43010","time_done":"2025-01-13 22:53:31.840329 UTC","time_started":"2025-01-13 22:53:31.254618 UTC"}
86872025-01-13T22:53:32.003ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
86882025-01-13T22:53:32.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86892025-01-13T22:53:32.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86902025-01-13T22:53:32.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912025-01-13T22:53:32.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86922025-01-13T22:53:32.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86932025-01-13T22:53:32.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86942025-01-13T22:53:32.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86952025-01-13T22:53:32.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86962025-01-13T22:53:32.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972025-01-13T22:53:32.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86982025-01-13T22:53:32.016ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86992025-01-13T22:53:32.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87002025-01-13T22:53:32.054ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 51.52492ms iteration = 24 status = {"physical_disks_added":0}
87012025-01-13T22:53:32.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a9fab7c-117d-44e0-9214-44a3c9c4a2bf roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87022025-01-13T22:53:32.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a9fab7c-117d-44e0-9214-44a3c9c4a2bf resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87032025-01-13T22:53:32.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7a9fab7c-117d-44e0-9214-44a3c9c4a2bf response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87042025-01-13T22:53:33.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d45391ae-b314-43e6-94a4-ee98109d5ece roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87052025-01-13T22:53:33.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d45391ae-b314-43e6-94a4-ee98109d5ece resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87062025-01-13T22:53:33.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d45391ae-b314-43e6-94a4-ee98109d5ece response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87072025-01-13T22:53:33.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 40084b78-0bca-41bc-9f54-2121f5180e25 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
87082025-01-13T22:53:34.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 163d0590-57a4-47d8-a67a-aba41eb87f66 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87092025-01-13T22:53:34.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 163d0590-57a4-47d8-a67a-aba41eb87f66 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87102025-01-13T22:53:34.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 163d0590-57a4-47d8-a67a-aba41eb87f66 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87112025-01-13T22:53:35.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ea34bfb2-471b-4551-9ae8-c4a05d34f726 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87122025-01-13T22:53:35.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ea34bfb2-471b-4551-9ae8-c4a05d34f726 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87132025-01-13T22:53:35.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ea34bfb2-471b-4551-9ae8-c4a05d34f726 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87142025-01-13T22:53:36.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c7f8471-3c1d-417d-b003-ca5ddc63fc3e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87152025-01-13T22:53:36.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c7f8471-3c1d-417d-b003-ca5ddc63fc3e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87162025-01-13T22:53:36.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c7f8471-3c1d-417d-b003-ca5ddc63fc3e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87172025-01-13T22:53:37.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 872690dc-d95f-498c-a447-93123a23520c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87182025-01-13T22:53:37.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 872690dc-d95f-498c-a447-93123a23520c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87192025-01-13T22:53:37.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 872690dc-d95f-498c-a447-93123a23520c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87202025-01-13T22:53:38.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55cbcbc2-1757-425f-a9a4-e713a55e57c3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87212025-01-13T22:53:38.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55cbcbc2-1757-425f-a9a4-e713a55e57c3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87222025-01-13T22:53:38.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55cbcbc2-1757-425f-a9a4-e713a55e57c3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87232025-01-13T22:53:39.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1239bde5-ce73-4413-9110-f962ba7963da roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87242025-01-13T22:53:39.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1239bde5-ce73-4413-9110-f962ba7963da resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87252025-01-13T22:53:39.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1239bde5-ce73-4413-9110-f962ba7963da response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87262025-01-13T22:53:40.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4c72885c-033c-4087-b78a-19101f05a400 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87272025-01-13T22:53:40.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4c72885c-033c-4087-b78a-19101f05a400 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87282025-01-13T22:53:40.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4c72885c-033c-4087-b78a-19101f05a400 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87292025-01-13T22:53:41.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
87302025-01-13T22:53:41.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87312025-01-13T22:53:41.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
87322025-01-13T22:53:41.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87332025-01-13T22:53:41.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87342025-01-13T22:53:41.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87352025-01-13T22:53:41.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87362025-01-13T22:53:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87372025-01-13T22:53:41.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87382025-01-13T22:53:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87392025-01-13T22:53:41.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87402025-01-13T22:53:41.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87412025-01-13T22:53:41.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87422025-01-13T22:53:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
87432025-01-13T22:53:41.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87442025-01-13T22:53:41.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87452025-01-13T22:53:41.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
87462025-01-13T22:53:41.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.22375ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
87472025-01-13T22:53:41.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87482025-01-13T22:53:41.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87492025-01-13T22:53:41.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.805128ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87502025-01-13T22:53:41.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8c6f0ef1-7f05-4ceb-bf6c-7d1a1a16bbdc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87512025-01-13T22:53:41.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8c6f0ef1-7f05-4ceb-bf6c-7d1a1a16bbdc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87522025-01-13T22:53:41.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8c6f0ef1-7f05-4ceb-bf6c-7d1a1a16bbdc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87532025-01-13T22:53:42.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72028459-a590-4d14-b013-607a1016c4ba roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87542025-01-13T22:53:42.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72028459-a590-4d14-b013-607a1016c4ba resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87552025-01-13T22:53:42.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 72028459-a590-4d14-b013-607a1016c4ba response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87562025-01-13T22:53:43.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 53fa0d7a-19e1-4f57-ab3e-6bd690516ddb roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
87572025-01-13T22:53:43.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 53fa0d7a-19e1-4f57-ab3e-6bd690516ddb resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
87582025-01-13T22:53:43.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 53fa0d7a-19e1-4f57-ab3e-6bd690516ddb response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
87592025-01-13T22:53:43.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = cbfffae6-cb3d-40ab-aa97-3b969ef54017 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
87602025-01-13T22:53:43.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = cbfffae6-cb3d-40ab-aa97-3b969ef54017 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
87612025-01-13T22:53:43.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = cbfffae6-cb3d-40ab-aa97-3b969ef54017 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
87622025-01-13T22:53:43.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = c6e04663-74a8-4a95-b88c-05dad7486060 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
87632025-01-13T22:53:43.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 51a035e8-87b5-4872-80ea-b59047594559 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87642025-01-13T22:53:43.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 51a035e8-87b5-4872-80ea-b59047594559 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87652025-01-13T22:53:43.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 51a035e8-87b5-4872-80ea-b59047594559 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87662025-01-13T22:53:44.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4f1059f0-cb23-47ae-b01b-de28f791ec2e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87672025-01-13T22:53:44.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4f1059f0-cb23-47ae-b01b-de28f791ec2e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87682025-01-13T22:53:44.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4f1059f0-cb23-47ae-b01b-de28f791ec2e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87692025-01-13T22:53:45.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e62095d7-bcdd-4742-82fe-8697fe15c0bc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87702025-01-13T22:53:45.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e62095d7-bcdd-4742-82fe-8697fe15c0bc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87712025-01-13T22:53:45.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e62095d7-bcdd-4742-82fe-8697fe15c0bc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87722025-01-13T22:53:46.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 17615db5-5a66-47fe-bb62-4ab83f313dd8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87732025-01-13T22:53:46.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 17615db5-5a66-47fe-bb62-4ab83f313dd8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87742025-01-13T22:53:46.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 17615db5-5a66-47fe-bb62-4ab83f313dd8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87752025-01-13T22:53:47.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 79020ec0-75e9-42dd-9121-51104cec9ee2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87762025-01-13T22:53:47.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 79020ec0-75e9-42dd-9121-51104cec9ee2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87772025-01-13T22:53:47.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 79020ec0-75e9-42dd-9121-51104cec9ee2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87782025-01-13T22:53:48.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d87ab966-51e4-4c5d-8d83-b625b4ca62e2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87792025-01-13T22:53:48.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d87ab966-51e4-4c5d-8d83-b625b4ca62e2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87802025-01-13T22:53:48.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d87ab966-51e4-4c5d-8d83-b625b4ca62e2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87812025-01-13T22:53:49.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c7f91180-6cbb-45ec-b645-41313b6c8b4d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87822025-01-13T22:53:49.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c7f91180-6cbb-45ec-b645-41313b6c8b4d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87832025-01-13T22:53:49.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c7f91180-6cbb-45ec-b645-41313b6c8b4d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87842025-01-13T22:53:50.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3b8116d6-db61-4d5a-b1a3-1c16e807bdbe roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87852025-01-13T22:53:50.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3b8116d6-db61-4d5a-b1a3-1c16e807bdbe resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87862025-01-13T22:53:50.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3b8116d6-db61-4d5a-b1a3-1c16e807bdbe response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
87872025-01-13T22:53:51.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
87882025-01-13T22:53:51.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
87892025-01-13T22:53:51.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87902025-01-13T22:53:51.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87912025-01-13T22:53:51.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87922025-01-13T22:53:51.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87932025-01-13T22:53:51.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87942025-01-13T22:53:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87952025-01-13T22:53:51.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87962025-01-13T22:53:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87972025-01-13T22:53:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87982025-01-13T22:53:51.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87992025-01-13T22:53:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88002025-01-13T22:53:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
88012025-01-13T22:53:51.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88022025-01-13T22:53:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88032025-01-13T22:53:51.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
88042025-01-13T22:53:51.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.227444ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
88052025-01-13T22:53:51.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88062025-01-13T22:53:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88072025-01-13T22:53:51.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.722084ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88082025-01-13T22:53:51.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cca1f129-a3b2-404e-a89a-a9d7eb4c1041 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88092025-01-13T22:53:51.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cca1f129-a3b2-404e-a89a-a9d7eb4c1041 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88102025-01-13T22:53:51.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cca1f129-a3b2-404e-a89a-a9d7eb4c1041 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88112025-01-13T22:53:52.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43d9fa21-a851-4429-b1df-18d6bf4c6d7a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88122025-01-13T22:53:52.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43d9fa21-a851-4429-b1df-18d6bf4c6d7a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88132025-01-13T22:53:52.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43d9fa21-a851-4429-b1df-18d6bf4c6d7a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88142025-01-13T22:53:53.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 585 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = d704486c-2970-4364-8c88-5a7bb1eb2b3e response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
88152025-01-13T22:53:53.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c06fec57-b359-490b-8fc7-6a6591ea6fc8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88162025-01-13T22:53:53.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c06fec57-b359-490b-8fc7-6a6591ea6fc8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88172025-01-13T22:53:53.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c06fec57-b359-490b-8fc7-6a6591ea6fc8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88182025-01-13T22:53:54.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4bb73025-59f8-4b5b-8509-f30b746aa3df roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88192025-01-13T22:53:54.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4bb73025-59f8-4b5b-8509-f30b746aa3df resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88202025-01-13T22:53:54.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4bb73025-59f8-4b5b-8509-f30b746aa3df response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88212025-01-13T22:53:55.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eba71e50-9ec9-4be4-84e2-f8b513ee975a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88222025-01-13T22:53:55.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eba71e50-9ec9-4be4-84e2-f8b513ee975a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88232025-01-13T22:53:55.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eba71e50-9ec9-4be4-84e2-f8b513ee975a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88242025-01-13T22:53:56.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a74b1b10-187f-4413-9af4-d58c20ef0911 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88252025-01-13T22:53:56.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a74b1b10-187f-4413-9af4-d58c20ef0911 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88262025-01-13T22:53:56.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a74b1b10-187f-4413-9af4-d58c20ef0911 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88272025-01-13T22:53:57.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21912598-8a26-4681-9acd-c67ed67019c7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88282025-01-13T22:53:57.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21912598-8a26-4681-9acd-c67ed67019c7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88292025-01-13T22:53:57.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 21912598-8a26-4681-9acd-c67ed67019c7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88302025-01-13T22:53:58.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2976b1bc-c6c0-4afc-9452-c9b35757c7e2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88312025-01-13T22:53:58.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2976b1bc-c6c0-4afc-9452-c9b35757c7e2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88322025-01-13T22:53:58.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2976b1bc-c6c0-4afc-9452-c9b35757c7e2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88332025-01-13T22:53:59.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3d49b0b-d837-4c7d-8819-0271124ba57c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88342025-01-13T22:53:59.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3d49b0b-d837-4c7d-8819-0271124ba57c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88352025-01-13T22:53:59.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c3d49b0b-d837-4c7d-8819-0271124ba57c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88362025-01-13T22:54:00.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = aab3dad3-e76d-4a8c-8ea1-faeac59ad799 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88372025-01-13T22:54:00.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = aab3dad3-e76d-4a8c-8ea1-faeac59ad799 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88382025-01-13T22:54:00.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = aab3dad3-e76d-4a8c-8ea1-faeac59ad799 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
88392025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
88402025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
88412025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88422025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
88432025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88442025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
88452025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88462025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
88472025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88482025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88492025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88502025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
88512025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88522025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
88532025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88542025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
88552025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
88562025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88572025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88582025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
88592025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88602025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
88612025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88622025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
88632025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88642025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
88652025-01-13T22:54:01.067ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88662025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
88672025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88682025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88692025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
88702025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88712025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
88722025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88732025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
88742025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
88752025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88762025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88772025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88782025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88792025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88802025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88812025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88822025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88832025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88842025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88852025-01-13T22:54:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88862025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88872025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88882025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88892025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88902025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88912025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88922025-01-13T22:54:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88932025-01-13T22:54:01.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88942025-01-13T22:54:01.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88952025-01-13T22:54:01.071ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.847951ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88962025-01-13T22:54:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88972025-01-13T22:54:01.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88982025-01-13T22:54:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88992025-01-13T22:54:01.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89002025-01-13T22:54:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89012025-01-13T22:54:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89022025-01-13T22:54:01.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89032025-01-13T22:54:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89042025-01-13T22:54:01.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89052025-01-13T22:54:01.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.455252ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
89062025-01-13T22:54:01.080ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3300, tv_nsec: 708315831 } })
89072025-01-13T22:54:01.080ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
89082025-01-13T22:54:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89092025-01-13T22:54:01.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89102025-01-13T22:54:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89112025-01-13T22:54:01.086ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3300, tv_nsec: 714403613 } })
89122025-01-13T22:54:01.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
89132025-01-13T22:54:01.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89142025-01-13T22:54:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89152025-01-13T22:54:01.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89162025-01-13T22:54:01.087ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3300, tv_nsec: 715793317 } })
89172025-01-13T22:54:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89182025-01-13T22:54:01.088ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
89192025-01-13T22:54:01.116ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89202025-01-13T22:54:01.116ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89212025-01-13T22:54:01.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89222025-01-13T22:54:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89232025-01-13T22:54:01.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89242025-01-13T22:54:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89252025-01-13T22:54:01.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89262025-01-13T22:54:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89272025-01-13T22:54:01.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89282025-01-13T22:54:01.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89292025-01-13T22:54:01.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.371303ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89302025-01-13T22:54:01.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89312025-01-13T22:54:01.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89322025-01-13T22:54:01.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.357954ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
89332025-01-13T22:54:01.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89342025-01-13T22:54:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89352025-01-13T22:54:01.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89362025-01-13T22:54:01.126ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89372025-01-13T22:54:01.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89382025-01-13T22:54:01.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89392025-01-13T22:54:01.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89402025-01-13T22:54:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89412025-01-13T22:54:01.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89422025-01-13T22:54:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89432025-01-13T22:54:01.128ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89442025-01-13T22:54:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89452025-01-13T22:54:01.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89462025-01-13T22:54:01.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89472025-01-13T22:54:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89482025-01-13T22:54:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89492025-01-13T22:54:01.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89502025-01-13T22:54:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89512025-01-13T22:54:01.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89522025-01-13T22:54:01.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89532025-01-13T22:54:01.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.421507ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89542025-01-13T22:54:01.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89552025-01-13T22:54:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
89562025-01-13T22:54:01.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89572025-01-13T22:54:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89582025-01-13T22:54:01.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89592025-01-13T22:54:01.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89602025-01-13T22:54:01.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89612025-01-13T22:54:01.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89622025-01-13T22:54:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89632025-01-13T22:54:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
89642025-01-13T22:54:01.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89652025-01-13T22:54:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89662025-01-13T22:54:01.137ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.983591ms iteration = 22 status = 0
89672025-01-13T22:54:01.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89682025-01-13T22:54:01.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89692025-01-13T22:54:01.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89702025-01-13T22:54:01.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89712025-01-13T22:54:01.150ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
89722025-01-13T22:54:01.150ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.943338ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
89732025-01-13T22:54:01.155ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89742025-01-13T22:54:01.155ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89752025-01-13T22:54:01.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89762025-01-13T22:54:01.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89772025-01-13T22:54:01.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.66491ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89782025-01-13T22:54:01.158ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89792025-01-13T22:54:01.158ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.036132ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89802025-01-13T22:54:01.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89812025-01-13T22:54:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89822025-01-13T22:54:01.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89832025-01-13T22:54:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89842025-01-13T22:54:01.162ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89852025-01-13T22:54:01.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89862025-01-13T22:54:01.164ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89872025-01-13T22:54:01.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89882025-01-13T22:54:01.165ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89892025-01-13T22:54:01.165ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1e2f37f-680b-4af3-9985-85d244b4cd94", "content-length": "26", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
89902025-01-13T22:54:01.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89912025-01-13T22:54:01.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89922025-01-13T22:54:01.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89932025-01-13T22:54:01.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89942025-01-13T22:54:01.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89952025-01-13T22:54:01.170ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89962025-01-13T22:54:01.170ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89972025-01-13T22:54:01.171ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d1129c4-c21e-47e6-9b7e-be6b0f01d374", "content-length": "26", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
89982025-01-13T22:54:01.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89992025-01-13T22:54:01.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90002025-01-13T22:54:01.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90012025-01-13T22:54:01.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90022025-01-13T22:54:01.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
90032025-01-13T22:54:01.172ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90042025-01-13T22:54:01.172ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1db338f-a679-46a0-bba7-3bf095c20106", "content-length": "26", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90052025-01-13T22:54:01.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90062025-01-13T22:54:01.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90072025-01-13T22:54:01.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90082025-01-13T22:54:01.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90092025-01-13T22:54:01.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90102025-01-13T22:54:01.174ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
90112025-01-13T22:54:01.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90122025-01-13T22:54:01.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90132025-01-13T22:54:01.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90142025-01-13T22:54:01.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90152025-01-13T22:54:01.190ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.921035ms iteration = 25 status = {"physical_disks_added":0}
90162025-01-13T22:54:01.194ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90172025-01-13T22:54:01.194ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90182025-01-13T22:54:01.194ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.130088ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90192025-01-13T22:54:01.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.901786ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
90202025-01-13T22:54:01.200ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
90212025-01-13T22:54:01.200ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 132.654071ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
90222025-01-13T22:54:01.279ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 212.220844ms iteration = 22 status = {}
90232025-01-13T22:54:01.297ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90242025-01-13T22:54:01.298ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1994f858-97ed-44ad-a2d8-edfd1452cc74", "content-length": "1", "date": "Mon, 13 Jan 2025 22:54:00 GMT"} })
90252025-01-13T22:54:01.299ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90262025-01-13T22:54:01.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90272025-01-13T22:54:01.301ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.905106ms iteration = 22 status = null
90282025-01-13T22:54:01.307ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90292025-01-13T22:54:01.307ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "808aaa95-5d65-4ca0-8cac-8a4ed936740a", "content-length": "691", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90302025-01-13T22:54:01.307ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
90312025-01-13T22:54:01.307ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
90322025-01-13T22:54:01.307ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
90332025-01-13T22:54:01.309ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 241.69184ms iteration = 22 status = {}
90342025-01-13T22:54:01.311ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90352025-01-13T22:54:01.311ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90362025-01-13T22:54:01.312ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59b8b30d-ec15-48e2-9b30-e1d854070a3f", "content-length": "372", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90372025-01-13T22:54:01.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90382025-01-13T22:54:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90392025-01-13T22:54:01.350ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90402025-01-13T22:54:01.350ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90412025-01-13T22:54:01.350ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "31274a5e-feba-4856-8af8-c0e95b213ccd", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90422025-01-13T22:54:01.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90432025-01-13T22:54:01.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90442025-01-13T22:54:01.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90452025-01-13T22:54:01.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90462025-01-13T22:54:01.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90472025-01-13T22:54:01.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90482025-01-13T22:54:01.359ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90492025-01-13T22:54:01.359ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90502025-01-13T22:54:01.359ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a3cabb2-088c-42d8-a29a-ac49086823b4", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90512025-01-13T22:54:01.361ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.764528ms iteration = 22 status = {}
90522025-01-13T22:54:01.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90532025-01-13T22:54:01.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90542025-01-13T22:54:01.366ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
90552025-01-13T22:54:01.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90562025-01-13T22:54:01.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90572025-01-13T22:54:01.375ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90582025-01-13T22:54:01.375ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4961a88-d4f2-4ad9-af0e-85f66c4cc3d8", "content-length": "134", "date": "Mon, 13 Jan 2025 22:54:00 GMT"} })
90592025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90602025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
90612025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90622025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90632025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90642025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90652025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90662025-01-13T22:54:01.375ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90672025-01-13T22:54:01.376ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90682025-01-13T22:54:01.376ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90692025-01-13T22:54:01.376ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
90702025-01-13T22:54:01.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90712025-01-13T22:54:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90722025-01-13T22:54:01.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90732025-01-13T22:54:01.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "28c61f8c-aa86-4255-827a-ff53225ee4f5", "content-length": "2", "date": "Mon, 13 Jan 2025 22:54:00 GMT"} })
90742025-01-13T22:54:01.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90752025-01-13T22:54:01.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "79d1cf42-0ef3-4458-83fb-d036c4c0c9f3", "content-length": "51", "date": "Mon, 13 Jan 2025 22:54:00 GMT"} })
90762025-01-13T22:54:01.378ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
90772025-01-13T22:54:01.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90782025-01-13T22:54:01.468ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3532efa1-b732-4d94-8f99-d8fa519ff8f4", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90792025-01-13T22:54:01.468ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
90802025-01-13T22:54:01.468ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90812025-01-13T22:54:01.468ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f9e3ad6-bc0d-482d-b67d-e0ae1bb6d9bf", "content-length": "682", "date": "Mon, 13 Jan 2025 22:54:01 GMT"} })
90822025-01-13T22:54:01.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90832025-01-13T22:54:01.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90842025-01-13T22:54:01.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90852025-01-13T22:54:01.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90862025-01-13T22:54:01.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90872025-01-13T22:54:01.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90882025-01-13T22:54:01.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90892025-01-13T22:54:01.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90902025-01-13T22:54:01.489ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 421.820615ms iteration = 22 status = {}
90912025-01-13T22:54:01.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 4af03c4c-ce2e-47b1-894a-0ea0a1c90c69 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
90922025-01-13T22:54:01.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 4af03c4c-ce2e-47b1-894a-0ea0a1c90c69 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
90932025-01-13T22:54:01.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 4af03c4c-ce2e-47b1-894a-0ea0a1c90c69 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
90942025-01-13T22:54:01.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d50adf3-bc8e-4525-8098-5714a2724295 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
90952025-01-13T22:54:01.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d50adf3-bc8e-4525-8098-5714a2724295 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
90962025-01-13T22:54:01.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7d50adf3-bc8e-4525-8098-5714a2724295 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
90972025-01-13T22:54:03.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2bea4c36-b9c4-43c8-8d07-791443546201 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
90982025-01-13T22:54:03.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2bea4c36-b9c4-43c8-8d07-791443546201 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
90992025-01-13T22:54:03.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2bea4c36-b9c4-43c8-8d07-791443546201 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91002025-01-13T22:54:03.507ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 480 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 70c1a5fe-fcee-4eb1-afa9-817a98d51cf6 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
91012025-01-13T22:54:04.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b81aab1b-4c42-4f2b-a4b5-2c2738b0acf5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91022025-01-13T22:54:04.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b81aab1b-4c42-4f2b-a4b5-2c2738b0acf5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91032025-01-13T22:54:04.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b81aab1b-4c42-4f2b-a4b5-2c2738b0acf5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91042025-01-13T22:54:05.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7b5de155-fd94-4d40-b588-6f4714b62ff4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91052025-01-13T22:54:05.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7b5de155-fd94-4d40-b588-6f4714b62ff4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91062025-01-13T22:54:05.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7b5de155-fd94-4d40-b588-6f4714b62ff4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91072025-01-13T22:54:06.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05b1c8c8-15d5-4ffb-bf8b-8cb0958f8bce roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91082025-01-13T22:54:06.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05b1c8c8-15d5-4ffb-bf8b-8cb0958f8bce resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91092025-01-13T22:54:06.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 05b1c8c8-15d5-4ffb-bf8b-8cb0958f8bce response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91102025-01-13T22:54:07.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cbdcd2f6-9b85-4aba-90c6-c23c8f874307 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91112025-01-13T22:54:07.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cbdcd2f6-9b85-4aba-90c6-c23c8f874307 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91122025-01-13T22:54:07.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cbdcd2f6-9b85-4aba-90c6-c23c8f874307 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91132025-01-13T22:54:08.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6f2f8fdd-c1a7-4c2d-9c88-178f08c7f1fd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91142025-01-13T22:54:08.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6f2f8fdd-c1a7-4c2d-9c88-178f08c7f1fd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91152025-01-13T22:54:08.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6f2f8fdd-c1a7-4c2d-9c88-178f08c7f1fd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91162025-01-13T22:54:09.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = caa6c4ed-fa04-46bf-a9d2-6fc3ad1696e8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91172025-01-13T22:54:09.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = caa6c4ed-fa04-46bf-a9d2-6fc3ad1696e8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91182025-01-13T22:54:09.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = caa6c4ed-fa04-46bf-a9d2-6fc3ad1696e8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91192025-01-13T22:54:10.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = baebbafe-14e7-4ed1-809d-2faa9b8a5839 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91202025-01-13T22:54:10.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = baebbafe-14e7-4ed1-809d-2faa9b8a5839 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91212025-01-13T22:54:10.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = baebbafe-14e7-4ed1-809d-2faa9b8a5839 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91222025-01-13T22:54:11.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
91232025-01-13T22:54:11.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91242025-01-13T22:54:11.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
91252025-01-13T22:54:11.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91262025-01-13T22:54:11.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91272025-01-13T22:54:11.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91282025-01-13T22:54:11.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91292025-01-13T22:54:11.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91302025-01-13T22:54:11.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91312025-01-13T22:54:11.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.293275ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91322025-01-13T22:54:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91332025-01-13T22:54:11.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91342025-01-13T22:54:11.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91352025-01-13T22:54:11.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91362025-01-13T22:54:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91372025-01-13T22:54:11.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91382025-01-13T22:54:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
91392025-01-13T22:54:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91402025-01-13T22:54:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91412025-01-13T22:54:11.087ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
91422025-01-13T22:54:11.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.182423ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
91432025-01-13T22:54:11.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e8f4aaa-7393-414a-879e-2ab1f1392a99 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91442025-01-13T22:54:11.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e8f4aaa-7393-414a-879e-2ab1f1392a99 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91452025-01-13T22:54:11.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9e8f4aaa-7393-414a-879e-2ab1f1392a99 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91462025-01-13T22:54:12.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43491dfb-9dd8-45a4-966e-d464baaeda00 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91472025-01-13T22:54:12.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43491dfb-9dd8-45a4-966e-d464baaeda00 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91482025-01-13T22:54:12.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 43491dfb-9dd8-45a4-966e-d464baaeda00 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91492025-01-13T22:54:13.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d5feff4e-b7b6-4797-a438-07bf4d7ea46b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91502025-01-13T22:54:13.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d5feff4e-b7b6-4797-a438-07bf4d7ea46b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91512025-01-13T22:54:13.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d5feff4e-b7b6-4797-a438-07bf4d7ea46b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91522025-01-13T22:54:13.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 94bd60b4-7dfa-4dd8-ba5b-f78bdd71031d roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
91532025-01-13T22:54:13.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 94bd60b4-7dfa-4dd8-ba5b-f78bdd71031d resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
91542025-01-13T22:54:13.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 94bd60b4-7dfa-4dd8-ba5b-f78bdd71031d response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
91552025-01-13T22:54:13.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = f22b7c07-bf46-424e-b465-d7d941e1a324 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
91562025-01-13T22:54:13.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = f22b7c07-bf46-424e-b465-d7d941e1a324 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
91572025-01-13T22:54:13.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = f22b7c07-bf46-424e-b465-d7d941e1a324 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
91582025-01-13T22:54:13.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 9b9cdd05-cf47-4c3f-ab10-b6f3a5c24a46 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
91592025-01-13T22:54:14.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53052383-24a0-4912-ab3d-f68956eafa95 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91602025-01-13T22:54:14.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53052383-24a0-4912-ab3d-f68956eafa95 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91612025-01-13T22:54:14.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 53052383-24a0-4912-ab3d-f68956eafa95 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91622025-01-13T22:54:15.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e885ffa9-6764-48c0-a2e2-101f85bf0b75 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91632025-01-13T22:54:15.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e885ffa9-6764-48c0-a2e2-101f85bf0b75 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91642025-01-13T22:54:15.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e885ffa9-6764-48c0-a2e2-101f85bf0b75 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91652025-01-13T22:54:16.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c13a6966-9cff-457a-bfbc-2b025dd38d8d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91662025-01-13T22:54:16.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c13a6966-9cff-457a-bfbc-2b025dd38d8d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91672025-01-13T22:54:16.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c13a6966-9cff-457a-bfbc-2b025dd38d8d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91682025-01-13T22:54:17.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 77820ceb-9ad8-491a-844d-73c66ae109de roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91692025-01-13T22:54:17.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 77820ceb-9ad8-491a-844d-73c66ae109de resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91702025-01-13T22:54:17.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 77820ceb-9ad8-491a-844d-73c66ae109de response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91712025-01-13T22:54:18.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 20909ef7-9eab-44ed-93b4-dfcdb1114779 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91722025-01-13T22:54:18.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 20909ef7-9eab-44ed-93b4-dfcdb1114779 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91732025-01-13T22:54:18.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 20909ef7-9eab-44ed-93b4-dfcdb1114779 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91742025-01-13T22:54:19.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 26b49137-53ed-426c-8684-055d2d583156 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91752025-01-13T22:54:19.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 26b49137-53ed-426c-8684-055d2d583156 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91762025-01-13T22:54:19.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 26b49137-53ed-426c-8684-055d2d583156 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91772025-01-13T22:54:20.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c496708-be93-4acf-bb8b-0ba35c93e781 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91782025-01-13T22:54:20.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c496708-be93-4acf-bb8b-0ba35c93e781 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91792025-01-13T22:54:20.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5c496708-be93-4acf-bb8b-0ba35c93e781 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
91802025-01-13T22:54:21.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
91812025-01-13T22:54:21.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91822025-01-13T22:54:21.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
91832025-01-13T22:54:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91842025-01-13T22:54:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91852025-01-13T22:54:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91862025-01-13T22:54:21.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91872025-01-13T22:54:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91882025-01-13T22:54:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91892025-01-13T22:54:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91902025-01-13T22:54:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91912025-01-13T22:54:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91922025-01-13T22:54:21.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91932025-01-13T22:54:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
91942025-01-13T22:54:21.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91952025-01-13T22:54:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91962025-01-13T22:54:21.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
91972025-01-13T22:54:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.015595ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
91982025-01-13T22:54:21.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91992025-01-13T22:54:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92002025-01-13T22:54:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.015005ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92012025-01-13T22:54:21.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 896f255e-fdb7-4ad5-acd3-2959f366b598 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92022025-01-13T22:54:21.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 896f255e-fdb7-4ad5-acd3-2959f366b598 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92032025-01-13T22:54:21.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 896f255e-fdb7-4ad5-acd3-2959f366b598 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92042025-01-13T22:54:22.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69fd6a2c-f128-4993-910f-e2d4a79845d6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92052025-01-13T22:54:22.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69fd6a2c-f128-4993-910f-e2d4a79845d6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92062025-01-13T22:54:22.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69fd6a2c-f128-4993-910f-e2d4a79845d6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92072025-01-13T22:54:23.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 40b3d539-877e-4ee0-990f-8b5f8e1bc716 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92082025-01-13T22:54:23.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 40b3d539-877e-4ee0-990f-8b5f8e1bc716 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92092025-01-13T22:54:23.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 40b3d539-877e-4ee0-990f-8b5f8e1bc716 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92102025-01-13T22:54:23.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 52dabe16-1d20-4871-935c-3661bb389832 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
92112025-01-13T22:54:24.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 24a4dce9-3ce7-44de-8d92-c1ef4eabf428 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92122025-01-13T22:54:24.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 24a4dce9-3ce7-44de-8d92-c1ef4eabf428 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92132025-01-13T22:54:24.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 24a4dce9-3ce7-44de-8d92-c1ef4eabf428 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92142025-01-13T22:54:25.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a7fefcb-8116-483f-9b84-c58d2f44921a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92152025-01-13T22:54:25.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a7fefcb-8116-483f-9b84-c58d2f44921a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92162025-01-13T22:54:25.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8a7fefcb-8116-483f-9b84-c58d2f44921a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92172025-01-13T22:54:26.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7affe0e9-b5c5-46c4-908d-9656d7600c9d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92182025-01-13T22:54:26.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7affe0e9-b5c5-46c4-908d-9656d7600c9d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92192025-01-13T22:54:26.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7affe0e9-b5c5-46c4-908d-9656d7600c9d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92202025-01-13T22:54:27.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97bf33a9-7a6b-464e-abde-e4e977620fd6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92212025-01-13T22:54:27.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97bf33a9-7a6b-464e-abde-e4e977620fd6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92222025-01-13T22:54:27.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97bf33a9-7a6b-464e-abde-e4e977620fd6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92232025-01-13T22:54:28.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0ed70437-6f47-43b2-bb26-051f58b9e51e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92242025-01-13T22:54:28.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0ed70437-6f47-43b2-bb26-051f58b9e51e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92252025-01-13T22:54:28.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0ed70437-6f47-43b2-bb26-051f58b9e51e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92262025-01-13T22:54:29.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ba22ba4-d2a8-485f-8aff-5c4624dcc229 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92272025-01-13T22:54:29.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ba22ba4-d2a8-485f-8aff-5c4624dcc229 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92282025-01-13T22:54:29.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3ba22ba4-d2a8-485f-8aff-5c4624dcc229 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92292025-01-13T22:54:30.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e45466b5-3b39-4439-9177-4e998a0c54a5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92302025-01-13T22:54:30.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e45466b5-3b39-4439-9177-4e998a0c54a5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92312025-01-13T22:54:30.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e45466b5-3b39-4439-9177-4e998a0c54a5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
92322025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
92332025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92342025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
92352025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
92362025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92372025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92382025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
92392025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92402025-01-13T22:54:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
92412025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92422025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
92432025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
92442025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92452025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92462025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92472025-01-13T22:54:31.066ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3330, tv_nsec: 695046134 } })
92482025-01-13T22:54:31.066ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3330, tv_nsec: 695167248 } })
92492025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
92502025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
92512025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
92522025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92532025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92542025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92552025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
92562025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92572025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
92582025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92592025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
92602025-01-13T22:54:31.066ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92612025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
92622025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
92632025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92642025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92652025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
92662025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92672025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92682025-01-13T22:54:31.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
92692025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92702025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92712025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
92722025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
92732025-01-13T22:54:31.067ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92742025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92752025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
92762025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92772025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92782025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
92792025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92802025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
92812025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92822025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
92832025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92842025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
92852025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
92862025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92872025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92882025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
92892025-01-13T22:54:31.067ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:44:31.067115446 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92902025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92912025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
92922025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92932025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
92942025-01-13T22:54:31.067ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
92952025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.72\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
92962025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
92972025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
92982025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92992025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
93002025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
93012025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.238769ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
93022025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93032025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93042025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93052025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
93062025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
93072025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93082025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
93092025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.451116ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
93102025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93112025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93122025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93132025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93142025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93152025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93162025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93172025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93182025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93192025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
93202025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93212025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
93222025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93232025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93242025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93252025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93262025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93272025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93282025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93292025-01-13T22:54:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93302025-01-13T22:54:31.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93312025-01-13T22:54:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93322025-01-13T22:54:31.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93332025-01-13T22:54:31.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93342025-01-13T22:54:31.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93352025-01-13T22:54:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93362025-01-13T22:54:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.156601ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93372025-01-13T22:54:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93382025-01-13T22:54:31.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93392025-01-13T22:54:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93402025-01-13T22:54:31.074ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93412025-01-13T22:54:31.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93422025-01-13T22:54:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93432025-01-13T22:54:31.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93442025-01-13T22:54:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
93452025-01-13T22:54:31.076ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93462025-01-13T22:54:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93472025-01-13T22:54:31.077ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93482025-01-13T22:54:31.077ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93492025-01-13T22:54:31.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93502025-01-13T22:54:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93512025-01-13T22:54:31.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93522025-01-13T22:54:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93532025-01-13T22:54:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93542025-01-13T22:54:31.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552025-01-13T22:54:31.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93562025-01-13T22:54:31.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93572025-01-13T22:54:31.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93582025-01-13T22:54:31.081ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3330, tv_nsec: 709988694 } })
93592025-01-13T22:54:31.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93602025-01-13T22:54:31.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93612025-01-13T22:54:31.085ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:44:31.067115446 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93622025-01-13T22:54:31.085ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.43725ms iteration = 12 status = {"expiration":"2025-01-13T22:44:31.067115446Z","pruned":[]}
93632025-01-13T22:54:31.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93642025-01-13T22:54:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93652025-01-13T22:54:31.087ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.943539ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
93662025-01-13T22:54:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93672025-01-13T22:54:31.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93682025-01-13T22:54:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93692025-01-13T22:54:31.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3330, tv_nsec: 716919702 } })
93702025-01-13T22:54:31.088ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93712025-01-13T22:54:31.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93722025-01-13T22:54:31.091ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93732025-01-13T22:54:31.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93742025-01-13T22:54:31.092ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93752025-01-13T22:54:31.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93762025-01-13T22:54:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93772025-01-13T22:54:31.094ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93782025-01-13T22:54:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93792025-01-13T22:54:31.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93802025-01-13T22:54:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93812025-01-13T22:54:31.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93822025-01-13T22:54:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93832025-01-13T22:54:31.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93842025-01-13T22:54:31.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3330, tv_nsec: 728760725 } })
93852025-01-13T22:54:31.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
93862025-01-13T22:54:31.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93872025-01-13T22:54:31.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93882025-01-13T22:54:31.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93892025-01-13T22:54:31.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93902025-01-13T22:54:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93912025-01-13T22:54:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93922025-01-13T22:54:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93932025-01-13T22:54:31.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93942025-01-13T22:54:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93952025-01-13T22:54:31.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962025-01-13T22:54:31.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
93972025-01-13T22:54:31.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93982025-01-13T22:54:31.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93992025-01-13T22:54:31.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94002025-01-13T22:54:31.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94012025-01-13T22:54:31.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94022025-01-13T22:54:31.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94032025-01-13T22:54:31.118ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
94042025-01-13T22:54:31.118ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
94052025-01-13T22:54:31.118ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.259772ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
94062025-01-13T22:54:31.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94072025-01-13T22:54:31.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94082025-01-13T22:54:31.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.262235ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
94092025-01-13T22:54:31.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102025-01-13T22:54:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94112025-01-13T22:54:31.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94122025-01-13T22:54:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94132025-01-13T22:54:31.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94142025-01-13T22:54:31.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94152025-01-13T22:54:31.126ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162025-01-13T22:54:31.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94172025-01-13T22:54:31.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94182025-01-13T22:54:31.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94192025-01-13T22:54:31.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94202025-01-13T22:54:31.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94212025-01-13T22:54:31.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94222025-01-13T22:54:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94232025-01-13T22:54:31.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94242025-01-13T22:54:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94252025-01-13T22:54:31.138ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94262025-01-13T22:54:31.138ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94272025-01-13T22:54:31.138ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94282025-01-13T22:54:31.138ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94292025-01-13T22:54:31.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94302025-01-13T22:54:31.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94312025-01-13T22:54:31.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94322025-01-13T22:54:31.140ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
94332025-01-13T22:54:31.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.379628ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
94342025-01-13T22:54:31.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94352025-01-13T22:54:31.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94362025-01-13T22:54:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94372025-01-13T22:54:31.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94382025-01-13T22:54:31.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94392025-01-13T22:54:31.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.637567ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94402025-01-13T22:54:31.142ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94412025-01-13T22:54:31.142ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94422025-01-13T22:54:31.142ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94432025-01-13T22:54:31.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94442025-01-13T22:54:31.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94452025-01-13T22:54:31.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.447052ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
94462025-01-13T22:54:31.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94472025-01-13T22:54:31.145ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.303193ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94482025-01-13T22:54:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94492025-01-13T22:54:31.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94502025-01-13T22:54:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94512025-01-13T22:54:31.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94522025-01-13T22:54:31.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94532025-01-13T22:54:31.147ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94542025-01-13T22:54:31.147ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94552025-01-13T22:54:31.147ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94562025-01-13T22:54:31.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94572025-01-13T22:54:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94582025-01-13T22:54:31.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94592025-01-13T22:54:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94602025-01-13T22:54:31.148ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94612025-01-13T22:54:31.148ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94622025-01-13T22:54:31.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94632025-01-13T22:54:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94642025-01-13T22:54:31.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94652025-01-13T22:54:31.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94662025-01-13T22:54:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94672025-01-13T22:54:31.151ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
94682025-01-13T22:54:31.151ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
94692025-01-13T22:54:31.151ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.427895ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
94702025-01-13T22:54:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94712025-01-13T22:54:31.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94722025-01-13T22:54:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94732025-01-13T22:54:31.152ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94742025-01-13T22:54:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94752025-01-13T22:54:31.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94762025-01-13T22:54:31.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94772025-01-13T22:54:31.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94782025-01-13T22:54:31.155ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792025-01-13T22:54:31.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
94802025-01-13T22:54:31.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94812025-01-13T22:54:31.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94822025-01-13T22:54:31.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94832025-01-13T22:54:31.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94842025-01-13T22:54:31.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94852025-01-13T22:54:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
94862025-01-13T22:54:31.159ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94872025-01-13T22:54:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94882025-01-13T22:54:31.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94892025-01-13T22:54:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94902025-01-13T22:54:31.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94912025-01-13T22:54:31.161ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
94922025-01-13T22:54:31.161ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 94.556823ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
94932025-01-13T22:54:31.163ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
94942025-01-13T22:54:31.163ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94952025-01-13T22:54:31.163ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
94962025-01-13T22:54:31.163ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 97.742093ms iteration = 12 status = {"generation":1}
94972025-01-13T22:54:31.166ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.455728ms iteration = 23 status = 0
94982025-01-13T22:54:31.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94992025-01-13T22:54:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95002025-01-13T22:54:31.186ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95012025-01-13T22:54:31.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95022025-01-13T22:54:31.188ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.879923ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95032025-01-13T22:54:31.189ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95042025-01-13T22:54:31.189ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.76713ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95052025-01-13T22:54:31.194ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) }
95062025-01-13T22:54:31.194ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 128.80509ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
95072025-01-13T22:54:31.201ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95082025-01-13T22:54:31.201ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95092025-01-13T22:54:31.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.199919ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
95102025-01-13T22:54:31.204ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
95112025-01-13T22:54:31.204ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
95122025-01-13T22:54:31.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95132025-01-13T22:54:31.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95142025-01-13T22:54:31.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95152025-01-13T22:54:31.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 163.171041ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
95162025-01-13T22:54:31.236ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
95172025-01-13T22:54:31.236ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95182025-01-13T22:54:31.236ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c55561e-01eb-4ee3-ab32-6fc19333accc", "content-length": "26", "date": "Mon, 13 Jan 2025 22:54:30 GMT"} })
95192025-01-13T22:54:31.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95202025-01-13T22:54:31.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95212025-01-13T22:54:31.246ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
95222025-01-13T22:54:31.247ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 180.127954ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
95232025-01-13T22:54:31.254ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.134024ms iteration = 26 status = {"physical_disks_added":0}
95242025-01-13T22:54:31.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
95252025-01-13T22:54:31.282ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95262025-01-13T22:54:31.283ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02f7ecf8-a928-47c8-8095-fe17e5b4007e", "content-length": "26", "date": "Mon, 13 Jan 2025 22:54:30 GMT"} })
95272025-01-13T22:54:31.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95282025-01-13T22:54:31.285ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95292025-01-13T22:54:31.285ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
95302025-01-13T22:54:31.285ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95312025-01-13T22:54:31.286ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95322025-01-13T22:54:31.286ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "439c8a5e-c125-4f21-ac35-d8b38a0c63ee", "content-length": "26", "date": "Mon, 13 Jan 2025 22:54:30 GMT"} })
95332025-01-13T22:54:31.286ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95342025-01-13T22:54:31.287ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
95352025-01-13T22:54:31.386ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
95362025-01-13T22:54:31.387ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cd3d75fd-c9c1-48ef-b596-1cbd6d01b848", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95372025-01-13T22:54:31.387ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95382025-01-13T22:54:31.388ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e4b96153-2391-4921-a616-fd5f311fe749", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95392025-01-13T22:54:31.388ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95402025-01-13T22:54:31.390ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95412025-01-13T22:54:31.390ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.287358ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95422025-01-13T22:54:31.458ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 391.326925ms iteration = 23 status = {}
95432025-01-13T22:54:31.535ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95442025-01-13T22:54:31.536ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffe3c2b4-2cdc-4104-be38-0be3777cfcc5", "content-length": "691", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
95452025-01-13T22:54:31.536ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95462025-01-13T22:54:31.536ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95472025-01-13T22:54:31.536ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95482025-01-13T22:54:31.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ea3807a4-b539-493e-84d5-fccf8ea87cdd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
95492025-01-13T22:54:31.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95502025-01-13T22:54:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ea3807a4-b539-493e-84d5-fccf8ea87cdd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
95512025-01-13T22:54:31.538ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.787226ms iteration = 23 status = {}
95522025-01-13T22:54:31.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95532025-01-13T22:54:31.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95542025-01-13T22:54:31.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95552025-01-13T22:54:31.542ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
95562025-01-13T22:54:31.542ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
95572025-01-13T22:54:31.542ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
95582025-01-13T22:54:31.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 476.250606ms iteration = 12 status = {"generation":2}
95592025-01-13T22:54:31.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = ea3807a4-b539-493e-84d5-fccf8ea87cdd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
95602025-01-13T22:54:31.551ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95612025-01-13T22:54:31.551ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95622025-01-13T22:54:31.552ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "de164f79-dc44-4192-9a8d-f16bd4fca318", "content-length": "372", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
95632025-01-13T22:54:31.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95642025-01-13T22:54:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95652025-01-13T22:54:31.591ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95662025-01-13T22:54:31.591ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95672025-01-13T22:54:31.592ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c0470a66-3e77-4d24-8349-48adca31cae9", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
95682025-01-13T22:54:31.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95692025-01-13T22:54:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95702025-01-13T22:54:31.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95712025-01-13T22:54:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95722025-01-13T22:54:31.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95732025-01-13T22:54:31.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95742025-01-13T22:54:31.600ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95752025-01-13T22:54:31.600ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95762025-01-13T22:54:31.601ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "33b9e635-74d4-47e9-8085-d955e6df6701", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
95772025-01-13T22:54:31.602ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 535.642893ms iteration = 23 status = {}
95782025-01-13T22:54:31.609ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95792025-01-13T22:54:31.610ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "76f2a9ec-b1c9-46de-96ca-27eccf77667d", "content-length": "1", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
95802025-01-13T22:54:31.612ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95812025-01-13T22:54:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95822025-01-13T22:54:31.614ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 547.036542ms iteration = 23 status = null
95832025-01-13T22:54:31.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9756bfdf-1893-4b6a-9983-ed8f39476e8e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
95842025-01-13T22:54:31.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9756bfdf-1893-4b6a-9983-ed8f39476e8e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
95852025-01-13T22:54:31.617ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
95862025-01-13T22:54:31.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9756bfdf-1893-4b6a-9983-ed8f39476e8e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
95872025-01-13T22:54:31.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95882025-01-13T22:54:31.683ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f84d58a5-b40c-460e-90c8-cb5659852213", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95892025-01-13T22:54:31.683ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95902025-01-13T22:54:31.684ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "15792d92-fbbe-45e7-80d0-273bc01aa55e", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95912025-01-13T22:54:31.684ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95922025-01-13T22:54:31.686ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "00079d7c-84d9-4ee5-89e4-4bc1b232a010", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95932025-01-13T22:54:31.686ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95942025-01-13T22:54:31.688ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95952025-01-13T22:54:31.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 622.783484ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95962025-01-13T22:54:31.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95972025-01-13T22:54:31.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95982025-01-13T22:54:31.706ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
95992025-01-13T22:54:31.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96002025-01-13T22:54:31.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96012025-01-13T22:54:31.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
96022025-01-13T22:54:31.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7881c8a6-42e7-4fa5-9a4f-a8034cd24c1d", "content-length": "134", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
96032025-01-13T22:54:31.715ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
96042025-01-13T22:54:31.715ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
96052025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
96062025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96072025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96082025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96092025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96102025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96112025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96122025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96132025-01-13T22:54:31.716ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
96142025-01-13T22:54:31.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96152025-01-13T22:54:31.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96162025-01-13T22:54:31.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96172025-01-13T22:54:31.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c7142b3-5a6b-4a84-8a55-b272a836d5b7", "content-length": "2", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
96182025-01-13T22:54:31.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96192025-01-13T22:54:31.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd029834-79d9-4b11-ac59-5006fb293432", "content-length": "51", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
96202025-01-13T22:54:31.718ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
96212025-01-13T22:54:31.718ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96222025-01-13T22:54:31.812ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "96fa42d2-f520-43c8-ad03-4cad560de905", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
96232025-01-13T22:54:31.812ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
96242025-01-13T22:54:31.812ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96252025-01-13T22:54:31.813ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "80904df4-e455-4ae2-9435-cdb1b9ae03b5", "content-length": "682", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
96262025-01-13T22:54:31.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96272025-01-13T22:54:31.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96282025-01-13T22:54:31.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96292025-01-13T22:54:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96302025-01-13T22:54:31.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96312025-01-13T22:54:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96322025-01-13T22:54:31.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96332025-01-13T22:54:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96342025-01-13T22:54:31.829ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 762.91107ms iteration = 23 status = {}
96352025-01-13T22:54:31.831ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
96362025-01-13T22:54:31.831ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
96372025-01-13T22:54:31.861ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
96382025-01-13T22:54:31.862ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:42294
96392025-01-13T22:54:31.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42294 req_id = 28c50b5d-64ac-40fc-a3b3-6b12f5be4e91 roles = RoleSet { roles: {} } uri = /metrics/producers
96402025-01-13T22:54:31.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42294 req_id = 28c50b5d-64ac-40fc-a3b3-6b12f5be4e91 resource = Database result = Ok(()) uri = /metrics/producers
96412025-01-13T22:54:31.898ZINFOnexus: assigned collector to new producer collector_id = 6a8a13ba-b82f-41ac-997c-fb535838d6a4 file = nexus/src/app/oximeter.rs:76 producer_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
96422025-01-13T22:54:31.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36613 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42294 req_id = 28c50b5d-64ac-40fc-a3b3-6b12f5be4e91 response_code = 201 uri = /metrics/producers
96432025-01-13T22:54:31.898ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "28c50b5d-64ac-40fc-a3b3-6b12f5be4e91", "content-length": "41", "date": "Mon, 13 Jan 2025 22:54:31 GMT"} })
96442025-01-13T22:54:31.899ZDEBGnexus (producer-registration-task): registered with nexus successfully
96452025-01-13T22:54:31.899ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
96462025-01-13T22:54:32.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2dcf03dc-83af-41da-bae5-86997ab3882b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96472025-01-13T22:54:32.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2dcf03dc-83af-41da-bae5-86997ab3882b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96482025-01-13T22:54:32.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2dcf03dc-83af-41da-bae5-86997ab3882b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96492025-01-13T22:54:33.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = ead6e359-c950-4683-8aec-7ef760f4b9a6 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
96502025-01-13T22:54:33.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a5850f3c-1e67-47c1-bf46-81bd39970eb4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96512025-01-13T22:54:33.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a5850f3c-1e67-47c1-bf46-81bd39970eb4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96522025-01-13T22:54:33.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a5850f3c-1e67-47c1-bf46-81bd39970eb4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96532025-01-13T22:54:34.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04835712-90a6-4bf8-9739-907a76278431 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96542025-01-13T22:54:34.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04835712-90a6-4bf8-9739-907a76278431 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96552025-01-13T22:54:34.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04835712-90a6-4bf8-9739-907a76278431 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96562025-01-13T22:54:35.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6e3c8481-0ffa-43bc-9ead-21cb6662576f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96572025-01-13T22:54:35.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6e3c8481-0ffa-43bc-9ead-21cb6662576f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96582025-01-13T22:54:35.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6e3c8481-0ffa-43bc-9ead-21cb6662576f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96592025-01-13T22:54:36.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dbcbd03d-7d18-4a4e-b144-aa03ab11d070 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96602025-01-13T22:54:36.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dbcbd03d-7d18-4a4e-b144-aa03ab11d070 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96612025-01-13T22:54:36.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = dbcbd03d-7d18-4a4e-b144-aa03ab11d070 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96622025-01-13T22:54:37.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fa7d04f-d46e-446a-a9d0-cd0ffb0d39de roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96632025-01-13T22:54:37.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fa7d04f-d46e-446a-a9d0-cd0ffb0d39de resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96642025-01-13T22:54:37.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fa7d04f-d46e-446a-a9d0-cd0ffb0d39de response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96652025-01-13T22:54:38.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7064c720-4bee-4f2c-bb55-3be804661083 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96662025-01-13T22:54:38.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7064c720-4bee-4f2c-bb55-3be804661083 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96672025-01-13T22:54:38.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7064c720-4bee-4f2c-bb55-3be804661083 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96682025-01-13T22:54:39.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d924cb65-db62-46ef-ad2d-11baa473ce08 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96692025-01-13T22:54:39.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d924cb65-db62-46ef-ad2d-11baa473ce08 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96702025-01-13T22:54:39.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d924cb65-db62-46ef-ad2d-11baa473ce08 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96712025-01-13T22:54:40.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9c2d04cd-ab66-4fb2-b149-1fda4d867da2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
96722025-01-13T22:54:40.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9c2d04cd-ab66-4fb2-b149-1fda4d867da2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
96732025-01-13T22:54:40.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 9c2d04cd-ab66-4fb2-b149-1fda4d867da2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
96742025-01-13T22:54:40.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d1871f53-8e20-4dd1-92c1-022ba00570c0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
96752025-01-13T22:54:40.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d1871f53-8e20-4dd1-92c1-022ba00570c0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
96762025-01-13T22:54:40.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d1871f53-8e20-4dd1-92c1-022ba00570c0 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
96772025-01-13T22:54:40.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b350898d-db4c-4296-b419-c574c41bee68 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96782025-01-13T22:54:40.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b350898d-db4c-4296-b419-c574c41bee68 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96792025-01-13T22:54:40.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b350898d-db4c-4296-b419-c574c41bee68 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
96802025-01-13T22:54:41.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
96812025-01-13T22:54:41.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
96822025-01-13T22:54:41.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96832025-01-13T22:54:41.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96842025-01-13T22:54:41.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96852025-01-13T22:54:41.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96862025-01-13T22:54:41.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96872025-01-13T22:54:41.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96882025-01-13T22:54:41.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.71923ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96892025-01-13T22:54:41.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96902025-01-13T22:54:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96912025-01-13T22:54:41.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96922025-01-13T22:54:41.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96932025-01-13T22:54:41.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96942025-01-13T22:54:41.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96952025-01-13T22:54:41.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96962025-01-13T22:54:41.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
96972025-01-13T22:54:41.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96982025-01-13T22:54:41.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96992025-01-13T22:54:41.137ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
97002025-01-13T22:54:41.137ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.490635ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
97012025-01-13T22:54:41.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a34c6fe7-1a23-4c48-97c9-5200269a78d1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97022025-01-13T22:54:41.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a34c6fe7-1a23-4c48-97c9-5200269a78d1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97032025-01-13T22:54:41.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a34c6fe7-1a23-4c48-97c9-5200269a78d1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97042025-01-13T22:54:42.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4757eec5-3dbc-42a6-86c7-508b3be81f1a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97052025-01-13T22:54:42.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4757eec5-3dbc-42a6-86c7-508b3be81f1a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97062025-01-13T22:54:42.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4757eec5-3dbc-42a6-86c7-508b3be81f1a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97072025-01-13T22:54:43.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 694 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 3c6d8c61-b598-4a74-bf47-5c48843d3e3c response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
97082025-01-13T22:54:43.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2a9e3e8b-9e88-4981-92fb-cda56bada3c1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97092025-01-13T22:54:43.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2a9e3e8b-9e88-4981-92fb-cda56bada3c1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97102025-01-13T22:54:43.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2a9e3e8b-9e88-4981-92fb-cda56bada3c1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97112025-01-13T22:54:44.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2d30676f-b4c6-4a87-9212-68b7685a2cc2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97122025-01-13T22:54:44.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2d30676f-b4c6-4a87-9212-68b7685a2cc2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97132025-01-13T22:54:44.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2d30676f-b4c6-4a87-9212-68b7685a2cc2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97142025-01-13T22:54:45.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c0765995-850a-4284-9ee0-ae94c8898bca roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97152025-01-13T22:54:45.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c0765995-850a-4284-9ee0-ae94c8898bca resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97162025-01-13T22:54:45.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c0765995-850a-4284-9ee0-ae94c8898bca response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97172025-01-13T22:54:46.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c08df12-2a81-4af7-94ed-0367f6f357a2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97182025-01-13T22:54:46.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c08df12-2a81-4af7-94ed-0367f6f357a2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97192025-01-13T22:54:46.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0c08df12-2a81-4af7-94ed-0367f6f357a2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97202025-01-13T22:54:47.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fb125d90-ede6-4ef3-8a1d-f1ed0da96959 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97212025-01-13T22:54:47.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fb125d90-ede6-4ef3-8a1d-f1ed0da96959 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97222025-01-13T22:54:47.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = fb125d90-ede6-4ef3-8a1d-f1ed0da96959 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97232025-01-13T22:54:48.353ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 799cb1a5-48e1-4b39-b3de-60c50e8be809 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-13T22:54:48.333101159Z }
97242025-01-13T22:54:48.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 799cb1a5-48e1-4b39-b3de-60c50e8be809 roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97252025-01-13T22:54:48.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 799cb1a5-48e1-4b39-b3de-60c50e8be809 resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97262025-01-13T22:54:48.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61368 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 799cb1a5-48e1-4b39-b3de-60c50e8be809 response_code = 204 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97272025-01-13T22:54:48.396ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 229c3daf-7c88-48d7-b683-60ad8fba5e6c uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-13T22:54:48.395411208Z }
97282025-01-13T22:54:48.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 229c3daf-7c88-48d7-b683-60ad8fba5e6c roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97292025-01-13T22:54:48.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 229c3daf-7c88-48d7-b683-60ad8fba5e6c resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97302025-01-13T22:54:48.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35410 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 229c3daf-7c88-48d7-b683-60ad8fba5e6c response_code = 204 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97312025-01-13T22:54:48.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c11c0fe4-67b6-4256-8162-b1f33a5428cc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97322025-01-13T22:54:48.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c11c0fe4-67b6-4256-8162-b1f33a5428cc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97332025-01-13T22:54:49.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c11c0fe4-67b6-4256-8162-b1f33a5428cc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97342025-01-13T22:54:50.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6af7ff31-4007-447a-a501-64110ec71b32 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97352025-01-13T22:54:50.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6af7ff31-4007-447a-a501-64110ec71b32 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97362025-01-13T22:54:50.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6af7ff31-4007-447a-a501-64110ec71b32 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97372025-01-13T22:54:51.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ee57b25b-9e81-4888-8625-7b4730289abf roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97382025-01-13T22:54:51.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ee57b25b-9e81-4888-8625-7b4730289abf resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97392025-01-13T22:54:51.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ee57b25b-9e81-4888-8625-7b4730289abf response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97402025-01-13T22:54:51.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
97412025-01-13T22:54:51.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
97422025-01-13T22:54:51.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97432025-01-13T22:54:51.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97442025-01-13T22:54:51.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97452025-01-13T22:54:51.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97462025-01-13T22:54:51.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97472025-01-13T22:54:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97482025-01-13T22:54:51.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97492025-01-13T22:54:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97502025-01-13T22:54:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97512025-01-13T22:54:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97522025-01-13T22:54:51.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97532025-01-13T22:54:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
97542025-01-13T22:54:51.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97552025-01-13T22:54:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97562025-01-13T22:54:51.087ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
97572025-01-13T22:54:51.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.375731ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
97582025-01-13T22:54:51.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97592025-01-13T22:54:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97602025-01-13T22:54:51.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.081485ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97612025-01-13T22:54:52.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c10f543b-19a2-4b3e-ab03-1389afc33b19 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97622025-01-13T22:54:52.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c10f543b-19a2-4b3e-ab03-1389afc33b19 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97632025-01-13T22:54:52.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = c10f543b-19a2-4b3e-ab03-1389afc33b19 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97642025-01-13T22:54:53.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2909216c-fb1e-4f8c-855e-7936e9dfe6db roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97652025-01-13T22:54:53.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2909216c-fb1e-4f8c-855e-7936e9dfe6db resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97662025-01-13T22:54:53.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2909216c-fb1e-4f8c-855e-7936e9dfe6db response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97672025-01-13T22:54:53.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 632 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 45a4cea9-3c60-45c4-8a93-d498e9395937 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
97682025-01-13T22:54:54.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6ba97c5a-f4eb-4c50-9f98-fd45dead8f85 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97692025-01-13T22:54:54.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6ba97c5a-f4eb-4c50-9f98-fd45dead8f85 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97702025-01-13T22:54:54.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6ba97c5a-f4eb-4c50-9f98-fd45dead8f85 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97712025-01-13T22:54:55.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d30f9ebb-0813-4578-bcbd-9806ea795b5e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97722025-01-13T22:54:55.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d30f9ebb-0813-4578-bcbd-9806ea795b5e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97732025-01-13T22:54:55.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d30f9ebb-0813-4578-bcbd-9806ea795b5e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97742025-01-13T22:54:56.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ea1f3634-4aad-4f62-b858-ad0f3fec0bdf roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97752025-01-13T22:54:56.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ea1f3634-4aad-4f62-b858-ad0f3fec0bdf resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97762025-01-13T22:54:56.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ea1f3634-4aad-4f62-b858-ad0f3fec0bdf response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97772025-01-13T22:54:57.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 39544708-895b-4c11-9195-3543a62817e3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97782025-01-13T22:54:57.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 39544708-895b-4c11-9195-3543a62817e3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97792025-01-13T22:54:57.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 39544708-895b-4c11-9195-3543a62817e3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97802025-01-13T22:54:58.084ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04121d32-7136-4a1b-afe4-ee4fb0ec13c3 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-13T22:54:58.084616299Z }
97812025-01-13T22:54:58.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04121d32-7136-4a1b-afe4-ee4fb0ec13c3 roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97822025-01-13T22:54:58.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04121d32-7136-4a1b-afe4-ee4fb0ec13c3 resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97832025-01-13T22:54:58.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9504 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 04121d32-7136-4a1b-afe4-ee4fb0ec13c3 response_code = 204 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
97842025-01-13T22:54:58.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba494b98-b611-4beb-b496-5d8b5011124e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97852025-01-13T22:54:58.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba494b98-b611-4beb-b496-5d8b5011124e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97862025-01-13T22:54:58.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ba494b98-b611-4beb-b496-5d8b5011124e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
97872025-01-13T22:54:58.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = fc3e1eef-a92e-427f-b5f3-163aeb654d11 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
97882025-01-13T22:54:58.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = fc3e1eef-a92e-427f-b5f3-163aeb654d11 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
97892025-01-13T22:54:58.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = fc3e1eef-a92e-427f-b5f3-163aeb654d11 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?sort_by=id_ascending
97902025-01-13T22:54:58.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 05ac7a57-c964-4afa-8204-37d00032ed91 roles = RoleSet { roles: {} } uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
97912025-01-13T22:54:58.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 05ac7a57-c964-4afa-8204-37d00032ed91 resource = Database result = Ok(()) uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
97922025-01-13T22:54:58.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46949 req_id = 05ac7a57-c964-4afa-8204-37d00032ed91 response_code = 200 uri = /metrics/collectors/6a8a13ba-b82f-41ac-997c-fb535838d6a4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDdmNDUyMC03MjVlLTRmMTYtYjVjNC03ZTBjZTQ2ZGFiZTcifX0%3D
97932025-01-13T22:54:58.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 16e4e64c-7cb0-4e9d-adc1-5b3c2a982d57 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
97942025-01-13T22:54:58.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 16e4e64c-7cb0-4e9d-adc1-5b3c2a982d57 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
97952025-01-13T22:54:58.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 16e4e64c-7cb0-4e9d-adc1-5b3c2a982d57 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
97962025-01-13T22:54:58.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 3c2bbc11-20fe-482c-9164-7cdb7c970928 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
97972025-01-13T22:54:58.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 3c2bbc11-20fe-482c-9164-7cdb7c970928 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
97982025-01-13T22:54:58.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 3c2bbc11-20fe-482c-9164-7cdb7c970928 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
97992025-01-13T22:54:59.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 934dab49-826a-4ec0-a819-e23d0826fce5 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
98002025-01-13T22:54:59.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 934dab49-826a-4ec0-a819-e23d0826fce5 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
98012025-01-13T22:54:59.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 934dab49-826a-4ec0-a819-e23d0826fce5 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
98022025-01-13T22:54:59.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = f876ada5-9ed2-4895-b353-7b8fb18bf3b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
98032025-01-13T22:54:59.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = f876ada5-9ed2-4895-b353-7b8fb18bf3b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
98042025-01-13T22:54:59.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = f876ada5-9ed2-4895-b353-7b8fb18bf3b1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
98052025-01-13T22:55:00.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 00beb066-92b9-4702-afb2-d47fc0d20e0c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
98062025-01-13T22:55:00.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 00beb066-92b9-4702-afb2-d47fc0d20e0c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
98072025-01-13T22:55:00.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 00beb066-92b9-4702-afb2-d47fc0d20e0c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
98082025-01-13T22:55:00.503ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T22:55:00.503402261Z }
98092025-01-13T22:55:00.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98102025-01-13T22:55:00.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98112025-01-13T22:55:00.512ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_needs_update = true
98122025-01-13T22:55:00.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98132025-01-13T22:55:00.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98142025-01-13T22:55:00.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98152025-01-13T22:55:00.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98162025-01-13T22:55:00.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98172025-01-13T22:55:00.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98182025-01-13T22:55:00.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98192025-01-13T22:55:00.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98202025-01-13T22:55:00.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98212025-01-13T22:55:00.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98222025-01-13T22:55:00.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98232025-01-13T22:55:00.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98242025-01-13T22:55:00.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98252025-01-13T22:55:00.526ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, lookup_type: ById(79ea48a0-40b4-4832-a95d-b4390d7ce4ec) }, key: 5ea9249f-2cdc-4d3f-9186-13bf67a3eb30, lookup_type: ById(5ea9249f-2cdc-4d3f-9186-13bf67a3eb30) }, key: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a, lookup_type: ById(740afc4c-5ffb-43cb-b3ca-967a2b0e427a) } result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98262025-01-13T22:55:00.531ZINFOnexus (dropshot_internal): starting update saga for 740afc4c-5ffb-43cb-b3ca-967a2b0e427a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T22:55:00.503402261Z }
98272025-01-13T22:55:00.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d response_code = 204 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98282025-01-13T22:55:00.534ZDEBGnexus (dropshot_internal): preparing instance-update saga for 740afc4c-5ffb-43cb-b3ca-967a2b0e427a... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 4aa8a8ad-0509-4cc1-bd5d-4f79ea98f85d uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98292025-01-13T22:55:00.534ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update
98302025-01-13T22:55:00.534ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd0e7491-56db-48d1-8daf-a6ac619f9ba8 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T22:55:00.503402261Z }
98312025-01-13T22:55:00.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd0e7491-56db-48d1-8daf-a6ac619f9ba8 roles = RoleSet { roles: {} } uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98322025-01-13T22:55:00.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd0e7491-56db-48d1-8daf-a6ac619f9ba8 resource = Database result = Ok(()) uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98332025-01-13T22:55:00.536ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"740afc4c-5ffb-43cb-b3ca-967a2b0e427a","lookup_type":{"ById":"740afc4c-5ffb-43cb-b3ca-967a2b0e427a"},"parent":{"key":"5ea9249f-2cdc-4d3f-9186-13bf67a3eb30","lookup_type":{"ById":"5ea9249f-2cdc-4d3f-9186-13bf67a3eb30"},"parent":{"key":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","lookup_type":{"ById":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98342025-01-13T22:55:00.536ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update
98352025-01-13T22:55:00.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38704 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cd0e7491-56db-48d1-8daf-a6ac619f9ba8 response_code = 204 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
98362025-01-13T22:55:00.584ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update
98372025-01-13T22:55:00.584ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98382025-01-13T22:55:00.584ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98392025-01-13T22:55:00.584ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98402025-01-13T22:55:00.589ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98412025-01-13T22:55:00.589ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98422025-01-13T22:55:00.593ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98432025-01-13T22:55:00.593ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98442025-01-13T22:55:00.599ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98452025-01-13T22:55:00.599ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("85f67aea-956c-4e94-8f1c-933c12c3dc9f")) node_id = 0 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98462025-01-13T22:55:00.604ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98472025-01-13T22:55:00.604ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98482025-01-13T22:55:00.618ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update
98492025-01-13T22:55:00.621ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98502025-01-13T22:55:00.621ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98512025-01-13T22:55:00.623ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98522025-01-13T22:55:00.624ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98532025-01-13T22:55:00.633ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98542025-01-13T22:55:00.634ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98552025-01-13T22:55:00.643ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98562025-01-13T22:55:00.643ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98572025-01-13T22:55:00.645ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98582025-01-13T22:55:00.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98592025-01-13T22:55:00.647ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98602025-01-13T22:55:00.647ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98612025-01-13T22:55:00.648ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98622025-01-13T22:55:00.652ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, lookup_type: ById(79ea48a0-40b4-4832-a95d-b4390d7ce4ec) }, key: 5ea9249f-2cdc-4d3f-9186-13bf67a3eb30, lookup_type: ById(5ea9249f-2cdc-4d3f-9186-13bf67a3eb30) }, key: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a, lookup_type: ById(740afc4c-5ffb-43cb-b3ca-967a2b0e427a) } result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98632025-01-13T22:55:00.654ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance updater_id = 85f67aea-956c-4e94-8f1c-933c12c3dc9f
98642025-01-13T22:55:00.655ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98652025-01-13T22:55:00.655ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98662025-01-13T22:55:00.670ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance updater_id = 85f67aea-956c-4e94-8f1c-933c12c3dc9f
98672025-01-13T22:55:00.670ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98682025-01-13T22:55:00.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance
98692025-01-13T22:55:00.676ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a locked_gen = Generation(Generation(2)) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = LockInstance updater_id = 85f67aea-956c-4e94-8f1c-933c12c3dc9f
98702025-01-13T22:55:00.676ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98712025-01-13T22:55:00.676ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("85f67aea-956c-4e94-8f1c-933c12c3dc9f")}) node_id = 1 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98722025-01-13T22:55:00.681ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98732025-01-13T22:55:00.681ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
98742025-01-13T22:55:00.690ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98752025-01-13T22:55:00.690ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98762025-01-13T22:55:00.692ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98772025-01-13T22:55:00.692ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98782025-01-13T22:55:00.693ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98792025-01-13T22:55:00.693ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98802025-01-13T22:55:00.695ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98812025-01-13T22:55:00.699ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, lookup_type: ById(79ea48a0-40b4-4832-a95d-b4390d7ce4ec) }, key: 5ea9249f-2cdc-4d3f-9186-13bf67a3eb30, lookup_type: ById(5ea9249f-2cdc-4d3f-9186-13bf67a3eb30) }, key: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a, lookup_type: ById(740afc4c-5ffb-43cb-b3ca-967a2b0e427a) } result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98822025-01-13T22:55:00.699ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98832025-01-13T22:55:00.699ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
98842025-01-13T22:55:00.709ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: ce44805e-b781-43b7-a6a4-15275635b21c, time_created: 2025-01-13T22:54:39.938925Z, time_deleted: None, instance_id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a, sled_id: bd8d50a3-f530-430e-8ded-11b6657cae3b, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-13T22:55:00.503402Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-13T22:54:37.804343Z, gen: Generation(Generation(3)), propolis_id: Some(ce44805e-b781-43b7-a6a4-15275635b21c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(ce44805e-b781-43b7-a6a4-15275635b21c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-13T22:55:00.709020597Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
98852025-01-13T22:55:00.716ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
98862025-01-13T22:55:00.716ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"740afc4c-5ffb-43cb-b3ca-967a2b0e427a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"ce44805e-b781-43b7-a6a4-15275635b21c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"740afc4c-5ffb-43cb-b3ca-967a2b0e427a","lookup_type":{"ById":"740afc4c-5ffb-43cb-b3ca-967a2b0e427a"},"parent":{"key":"5ea9249f-2cdc-4d3f-9186-13bf67a3eb30","lookup_type":{"ById":"5ea9249f-2cdc-4d3f-9186-13bf67a3eb30"},"parent":{"key":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","lookup_type":{"ById":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"85f67aea-956c-4e94-8f1c-933c12c3dc9f"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"5ea9249f-2cdc-4d3f-9186-13bf67a3eb30","ram_diff":1073741824},"destroy_active_vmm":"ce44805e-b781-43b7-a6a4-15275635b21c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-13T22:55:00.709020597Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98872025-01-13T22:55:00.716ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
98882025-01-13T22:55:00.720ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
98892025-01-13T22:55:00.720ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98902025-01-13T22:55:00.720ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98912025-01-13T22:55:00.720ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
98922025-01-13T22:55:00.724ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98932025-01-13T22:55:00.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
98942025-01-13T22:55:00.727ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98952025-01-13T22:55:00.727ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
98962025-01-13T22:55:00.731ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98972025-01-13T22:55:00.731ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("749acd24-ef1d-42e8-9ea4-3e503b2bab73")) node_id = 0 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
98982025-01-13T22:55:00.735ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
98992025-01-13T22:55:00.735ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99002025-01-13T22:55:00.740ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a parent_lock = UpdaterLock { updater_id: 85f67aea-956c-4e94-8f1c-933c12c3dc9f, locked_gen: Generation(Generation(2)) } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99012025-01-13T22:55:00.740ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = BecomeUpdater
99022025-01-13T22:55:00.741ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = BecomeUpdater
99032025-01-13T22:55:00.755ZDEBGnexus (SagaExecutor): inherited lock from 85f67aea-956c-4e94-8f1c-933c12c3dc9f to 749acd24-ef1d-42e8-9ea4-3e503b2bab73 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 85f67aea-956c-4e94-8f1c-933c12c3dc9f saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = BecomeUpdater updater_id = 749acd24-ef1d-42e8-9ea4-3e503b2bab73
99042025-01-13T22:55:00.755ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99052025-01-13T22:55:00.755ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99062025-01-13T22:55:00.755ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("749acd24-ef1d-42e8-9ea4-3e503b2bab73")}) node_id = 1 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99072025-01-13T22:55:00.759ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99082025-01-13T22:55:00.759ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99092025-01-13T22:55:00.762ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99102025-01-13T22:55:00.762ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99112025-01-13T22:55:00.765ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99122025-01-13T22:55:00.765ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99132025-01-13T22:55:00.768ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99142025-01-13T22:55:00.770ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a
99152025-01-13T22:55:00.770ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UpdateNetworkConfig
99162025-01-13T22:55:00.771ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UpdateNetworkConfig
99172025-01-13T22:55:00.773ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UpdateNetworkConfig
99182025-01-13T22:55:00.773ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UpdateNetworkConfig
99192025-01-13T22:55:00.777ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
99202025-01-13T22:55:00.777ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UpdateNetworkConfig
99212025-01-13T22:55:00.777ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UpdateNetworkConfig
99222025-01-13T22:55:00.779ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
99232025-01-13T22:55:00.779ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
99242025-01-13T22:55:00.779ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
99252025-01-13T22:55:00.781ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
99262025-01-13T22:55:00.782ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
99272025-01-13T22:55:00.782ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
99282025-01-13T22:55:00.782ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
99292025-01-13T22:55:00.791ZDEBGnexus: notifying dendrite of updates instance_id = Some(740afc4c-5ffb-43cb-b3ca-967a2b0e427a (instance)) switch = switch0
99302025-01-13T22:55:00.792ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3360, tv_nsec: 420895293 } })
99312025-01-13T22:55:00.792ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
99322025-01-13T22:55:00.826ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99332025-01-13T22:55:00.826ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99342025-01-13T22:55:00.826ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65f69cfc-724b-4158-bbb4-495ee2487daa", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
99352025-01-13T22:55:00.826ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99362025-01-13T22:55:00.827ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99372025-01-13T22:55:00.859ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
99382025-01-13T22:55:00.860ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "478fc0da-44d2-4e2b-a73c-7d39cd8cca67", "content-length": "4", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
99392025-01-13T22:55:00.861ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99402025-01-13T22:55:00.861ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99412025-01-13T22:55:00.868ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99422025-01-13T22:55:00.868ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99432025-01-13T22:55:00.876ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
99442025-01-13T22:55:00.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
99452025-01-13T22:55:00.891ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-13T22:55:00.879023Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5ea9249f-2cdc-4d3f-9186-13bf67a3eb30, time_modified: Some(2025-01-13T22:55:00.879023Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, time_modified: Some(2025-01-13T22:55:00.879023Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99462025-01-13T22:55:00.891ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99472025-01-13T22:55:00.891ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99482025-01-13T22:55:00.897ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99492025-01-13T22:55:00.897ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99502025-01-13T22:55:00.900ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99512025-01-13T22:55:00.900ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UnassignOximeterProducer
99522025-01-13T22:55:00.901ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UnassignOximeterProducer
99532025-01-13T22:55:00.910ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 6a8a13ba-b82f-41ac-997c-fb535838d6a4 producer_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99542025-01-13T22:55:00.910ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UnassignOximeterProducer
99552025-01-13T22:55:00.910ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = UnassignOximeterProducer
99562025-01-13T22:55:00.946ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99572025-01-13T22:55:00.948ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/740afc4c-5ffb-43cb-b3ca-967a2b0e427a
99582025-01-13T22:55:00.963ZDEBGnexus (SagaExecutor): client response oximeter-collector = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/740afc4c-5ffb-43cb-b3ca-967a2b0e427a", status: 204, headers: {"x-request-id": "c6e053ee-9eb4-4ca0-ba65-cd4fe00e5092", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} }) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99592025-01-13T22:55:00.963ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 6a8a13ba-b82f-41ac-997c-fb535838d6a4 producer_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99602025-01-13T22:55:00.965ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99612025-01-13T22:55:00.965ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99622025-01-13T22:55:00.969ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99632025-01-13T22:55:00.969ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99642025-01-13T22:55:00.974ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a lock = UpdaterLock { updater_id: 749acd24-ef1d-42e8-9ea4-3e503b2bab73, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-13T22:55:00.709020597Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99652025-01-13T22:55:00.974ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = CommitInstanceUpdates
99662025-01-13T22:55:00.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = CommitInstanceUpdates
99672025-01-13T22:55:00.986ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a new_runtime = InstanceRuntimeState { time_updated: 2025-01-13T22:55:00.709020597Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
99682025-01-13T22:55:00.987ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99692025-01-13T22:55:00.987ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99702025-01-13T22:55:00.987ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
99712025-01-13T22:55:00.987ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
99722025-01-13T22:55:00.987ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99732025-01-13T22:55:00.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99742025-01-13T22:55:00.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99752025-01-13T22:55:00.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99762025-01-13T22:55:00.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99772025-01-13T22:55:00.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99782025-01-13T22:55:00.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99792025-01-13T22:55:00.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99802025-01-13T22:55:00.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99812025-01-13T22:55:00.991ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99822025-01-13T22:55:00.991ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99832025-01-13T22:55:00.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99842025-01-13T22:55:00.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99852025-01-13T22:55:00.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99862025-01-13T22:55:00.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99872025-01-13T22:55:00.995ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99882025-01-13T22:55:00.995ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("740afc4c-5ffb-43cb-b3ca-967a2b0e427a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ce44805e-b781-43b7-a6a4-15275635b21c")}) node_id = 7 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99892025-01-13T22:55:00.999ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99902025-01-13T22:55:00.999ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99912025-01-13T22:55:01.002ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99922025-01-13T22:55:01.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
99932025-01-13T22:55:01.028ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99942025-01-13T22:55:01.028ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99952025-01-13T22:55:01.029ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d064327-5dfb-4d57-bf8a-ab02d9add661", "content-length": "372", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
99962025-01-13T22:55:01.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99972025-01-13T22:55:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99982025-01-13T22:55:01.032ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
99992025-01-13T22:55:01.032ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
100002025-01-13T22:55:01.038ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
100012025-01-13T22:55:01.038ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ReleaseSledResources
100022025-01-13T22:55:01.038ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ReleaseSledResources
100032025-01-13T22:55:01.050ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
100042025-01-13T22:55:01.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
100052025-01-13T22:55:01.054ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
100062025-01-13T22:55:01.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
100072025-01-13T22:55:01.058ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
100082025-01-13T22:55:01.058ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = MarkVmmDeleted
100092025-01-13T22:55:01.058ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = MarkVmmDeleted
100102025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
100112025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
100122025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100132025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100142025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
100152025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100162025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
100172025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100182025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
100192025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
100202025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100212025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100222025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
100232025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100242025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
100252025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100262025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
100272025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100282025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
100292025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100302025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
100312025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100322025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
100332025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
100342025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100352025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100362025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
100372025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
100382025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100392025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
100402025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100412025-01-13T22:55:01.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100422025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100432025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100442025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100452025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100462025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100472025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100482025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100492025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100502025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100512025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100522025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100532025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100542025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100552025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100562025-01-13T22:55:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100572025-01-13T22:55:01.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100582025-01-13T22:55:01.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100592025-01-13T22:55:01.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100602025-01-13T22:55:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100612025-01-13T22:55:01.070ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.958255ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100622025-01-13T22:55:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100632025-01-13T22:55:01.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100642025-01-13T22:55:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100652025-01-13T22:55:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100662025-01-13T22:55:01.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100672025-01-13T22:55:01.072ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d4c1a21e-1d28-4f7c-933a-2d78de20f95e: {10.151.2.176: {4f33b6ea-4000-437e-a1b6-9210ecc36092}, 10.151.2.175: {4f33b6ea-4000-437e-a1b6-9210ecc36092}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
100682025-01-13T22:55:01.072ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100692025-01-13T22:55:01.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3360, tv_nsec: 701019932 } })
100702025-01-13T22:55:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100712025-01-13T22:55:01.072ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2a41b6c6-0fe6-41a9-98d2-f7f702888ed6", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
100722025-01-13T22:55:01.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100732025-01-13T22:55:01.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
100742025-01-13T22:55:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100752025-01-13T22:55:01.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100762025-01-13T22:55:01.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3360, tv_nsec: 705601956 } })
100772025-01-13T22:55:01.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100782025-01-13T22:55:01.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100792025-01-13T22:55:01.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
100802025-01-13T22:55:01.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100812025-01-13T22:55:01.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.736152ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100822025-01-13T22:55:01.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100832025-01-13T22:55:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100842025-01-13T22:55:01.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100852025-01-13T22:55:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100862025-01-13T22:55:01.084ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3360, tv_nsec: 713651199 } })
100872025-01-13T22:55:01.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
100882025-01-13T22:55:01.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100892025-01-13T22:55:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100902025-01-13T22:55:01.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100912025-01-13T22:55:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100922025-01-13T22:55:01.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100932025-01-13T22:55:01.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100942025-01-13T22:55:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100952025-01-13T22:55:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100962025-01-13T22:55:01.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100972025-01-13T22:55:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100982025-01-13T22:55:01.094ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100992025-01-13T22:55:01.094ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101002025-01-13T22:55:01.094ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e26c3bb7-4c83-4189-a173-418bd0b573bf", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
101012025-01-13T22:55:01.096ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 109.185913ms iteration = 24 status = {}
101022025-01-13T22:55:01.096ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
101032025-01-13T22:55:01.096ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101042025-01-13T22:55:01.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101052025-01-13T22:55:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101062025-01-13T22:55:01.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101072025-01-13T22:55:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101082025-01-13T22:55:01.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101092025-01-13T22:55:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101102025-01-13T22:55:01.111ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
101112025-01-13T22:55:01.111ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
101122025-01-13T22:55:01.114ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101132025-01-13T22:55:01.114ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.256998ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101142025-01-13T22:55:01.116ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
101152025-01-13T22:55:01.116ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
101162025-01-13T22:55:01.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101172025-01-13T22:55:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101182025-01-13T22:55:01.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101192025-01-13T22:55:01.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101202025-01-13T22:55:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101212025-01-13T22:55:01.120ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
101222025-01-13T22:55:01.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232025-01-13T22:55:01.120ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
101242025-01-13T22:55:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
101252025-01-13T22:55:01.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101262025-01-13T22:55:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101272025-01-13T22:55:01.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101282025-01-13T22:55:01.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101292025-01-13T22:55:01.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101302025-01-13T22:55:01.124ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
101312025-01-13T22:55:01.124ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
101322025-01-13T22:55:01.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.753587ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
101332025-01-13T22:55:01.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.569912ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
101342025-01-13T22:55:01.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101352025-01-13T22:55:01.126ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101362025-01-13T22:55:01.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101372025-01-13T22:55:01.126ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101382025-01-13T22:55:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101392025-01-13T22:55:01.127ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
101402025-01-13T22:55:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101412025-01-13T22:55:01.128ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101422025-01-13T22:55:01.128ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
101432025-01-13T22:55:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101442025-01-13T22:55:01.128ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101452025-01-13T22:55:01.128ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101462025-01-13T22:55:01.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101472025-01-13T22:55:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101482025-01-13T22:55:01.130ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
101492025-01-13T22:55:01.130ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
101502025-01-13T22:55:01.143ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
101512025-01-13T22:55:01.143ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.699692ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
101522025-01-13T22:55:01.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101532025-01-13T22:55:01.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101542025-01-13T22:55:01.148ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101552025-01-13T22:55:01.149ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5220ab1-d08a-4eae-b85e-d2f66042daf2", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
101562025-01-13T22:55:01.149ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101572025-01-13T22:55:01.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101582025-01-13T22:55:01.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101592025-01-13T22:55:01.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101602025-01-13T22:55:01.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101612025-01-13T22:55:01.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101622025-01-13T22:55:01.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101632025-01-13T22:55:01.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.617992ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
101642025-01-13T22:55:01.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.801578ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101652025-01-13T22:55:01.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101662025-01-13T22:55:01.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101672025-01-13T22:55:01.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101682025-01-13T22:55:01.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101692025-01-13T22:55:01.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101702025-01-13T22:55:01.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101712025-01-13T22:55:01.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101722025-01-13T22:55:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101732025-01-13T22:55:01.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101742025-01-13T22:55:01.156ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101752025-01-13T22:55:01.156ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8fa5912-9590-4cd3-851d-410328c78221", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
101762025-01-13T22:55:01.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101772025-01-13T22:55:01.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101782025-01-13T22:55:01.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101792025-01-13T22:55:01.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101802025-01-13T22:55:01.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101812025-01-13T22:55:01.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101822025-01-13T22:55:01.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101832025-01-13T22:55:01.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101842025-01-13T22:55:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101852025-01-13T22:55:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
101862025-01-13T22:55:01.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101872025-01-13T22:55:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101882025-01-13T22:55:01.163ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.593808ms iteration = 24 status = 0
101892025-01-13T22:55:01.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.105977ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101902025-01-13T22:55:01.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101912025-01-13T22:55:01.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101922025-01-13T22:55:01.167ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101932025-01-13T22:55:01.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101942025-01-13T22:55:01.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101952025-01-13T22:55:01.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101962025-01-13T22:55:01.170ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
101972025-01-13T22:55:01.170ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 104.108664ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
101982025-01-13T22:55:01.180ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
101992025-01-13T22:55:01.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
102002025-01-13T22:55:01.182ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102012025-01-13T22:55:01.182ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102022025-01-13T22:55:01.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102032025-01-13T22:55:01.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102042025-01-13T22:55:01.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
102052025-01-13T22:55:01.182ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102062025-01-13T22:55:01.183ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f79c9cd1-a1d3-414a-8f28-c0dbdf797b61", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
102072025-01-13T22:55:01.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102082025-01-13T22:55:01.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
102092025-01-13T22:55:01.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102102025-01-13T22:55:01.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102112025-01-13T22:55:01.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102122025-01-13T22:55:01.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102132025-01-13T22:55:01.197ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.917297ms iteration = 27 status = {"physical_disks_added":0}
102142025-01-13T22:55:01.228ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 161.275181ms iteration = 24 status = {}
102152025-01-13T22:55:01.235ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102162025-01-13T22:55:01.235ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102172025-01-13T22:55:01.236ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e293a3b-14f7-47c7-a126-4d3eba030783", "content-length": "810", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
102182025-01-13T22:55:01.236ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(6563737) }} sled = sock
102192025-01-13T22:55:01.236ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(6563737) }] sled = sock
102202025-01-13T22:55:01.236ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = Some(Body) method = DELETE uri = http://[fd00:1122:3344:101::1]:12345/v2p
102212025-01-13T22:55:01.236ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6aaad0d-1a39-4cd7-8153-7658a294a873", "content-length": "2", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
102222025-01-13T22:55:01.236ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 204, headers: {"x-request-id": "14993feb-abe2-4c68-85f2-63cb099ebdcd", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
102232025-01-13T22:55:01.236ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
102242025-01-13T22:55:01.237ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
102252025-01-13T22:55:01.237ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 250.414354ms iteration = 24 status = {}
102262025-01-13T22:55:01.237ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
102272025-01-13T22:55:01.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102282025-01-13T22:55:01.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102292025-01-13T22:55:01.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102302025-01-13T22:55:01.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102312025-01-13T22:55:01.240ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, lookup_type: ById(79ea48a0-40b4-4832-a95d-b4390d7ce4ec) }, key: 5ea9249f-2cdc-4d3f-9186-13bf67a3eb30, lookup_type: ById(5ea9249f-2cdc-4d3f-9186-13bf67a3eb30) }, key: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a, lookup_type: ById(740afc4c-5ffb-43cb-b3ca-967a2b0e427a) } result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
102322025-01-13T22:55:01.240ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
102332025-01-13T22:55:01.240ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_node = ChainSuccessorSaga
102342025-01-13T22:55:01.242ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 175.22136ms iteration = 24 status = null
102352025-01-13T22:55:01.246ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a karmic_state = WillReincarnate needs_reincarnation = false saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update
102362025-01-13T22:55:01.246ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
102372025-01-13T22:55:01.246ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
102382025-01-13T22:55:01.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 757be85a-3f81-4d81-8a8f-8a30f1bdb5a3 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
102392025-01-13T22:55:01.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 757be85a-3f81-4d81-8a8f-8a30f1bdb5a3 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
102402025-01-13T22:55:01.265ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102412025-01-13T22:55:01.265ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102422025-01-13T22:55:01.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.472421ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102432025-01-13T22:55:01.276ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102442025-01-13T22:55:01.276ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102452025-01-13T22:55:01.277ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa1bcc7c-3a7c-4b50-8037-30c11e6332ec", "content-length": "372", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
102462025-01-13T22:55:01.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102472025-01-13T22:55:01.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102482025-01-13T22:55:01.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 757be85a-3f81-4d81-8a8f-8a30f1bdb5a3 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
102492025-01-13T22:55:01.281ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
102502025-01-13T22:55:01.281ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
102512025-01-13T22:55:01.284ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
102522025-01-13T22:55:01.284ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
102532025-01-13T22:55:01.288ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
102542025-01-13T22:55:01.288ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273
102552025-01-13T22:55:01.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102562025-01-13T22:55:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102572025-01-13T22:55:01.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102582025-01-13T22:55:01.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102592025-01-13T22:55:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102602025-01-13T22:55:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102612025-01-13T22:55:01.314ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
102622025-01-13T22:55:01.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102632025-01-13T22:55:01.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102642025-01-13T22:55:01.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102652025-01-13T22:55:01.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102662025-01-13T22:55:01.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102672025-01-13T22:55:01.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102682025-01-13T22:55:01.317ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102692025-01-13T22:55:01.317ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102702025-01-13T22:55:01.317ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c0f7bee-cf00-4c42-8924-508d7325f259", "date": "Mon, 13 Jan 2025 22:55:01 GMT"} })
102712025-01-13T22:55:01.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102722025-01-13T22:55:01.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102732025-01-13T22:55:01.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102742025-01-13T22:55:01.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102752025-01-13T22:55:01.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102762025-01-13T22:55:01.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102772025-01-13T22:55:01.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102782025-01-13T22:55:01.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "92142d04-5333-4f19-bae0-dc9d6640e7f8", "content-length": "134", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
102792025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102802025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
102812025-01-13T22:55:01.324ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
102822025-01-13T22:55:01.324ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 saga_name = instance-update saga_result = SagaResult { saga_id: bfde25b7-66f2-4124-b07c-cc66f76db273, saga_log: SagaLog { saga_id: bfde25b7-66f2-4124-b07c-cc66f76db273, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("749acd24-ef1d-42e8-9ea4-3e503b2bab73")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("749acd24-ef1d-42e8-9ea4-3e503b2bab73")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("740afc4c-5ffb-43cb-b3ca-967a2b0e427a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ce44805e-b781-43b7-a6a4-15275635b21c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("740afc4c-5ffb-43cb-b3ca-967a2b0e427a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ce44805e-b781-43b7-a6a4-15275635b21c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("749acd24-ef1d-42e8-9ea4-3e503b2bab73"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("749acd24-ef1d-42e8-9ea4-3e503b2bab73")}} }) }
102832025-01-13T22:55:01.324ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = bfde25b7-66f2-4124-b07c-cc66f76db273 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update
102842025-01-13T22:55:01.324ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
102852025-01-13T22:55:01.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
102862025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102872025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102882025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102892025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102902025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102912025-01-13T22:55:01.324ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102922025-01-13T22:55:01.325ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102932025-01-13T22:55:01.325ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102942025-01-13T22:55:01.325ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
102952025-01-13T22:55:01.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102962025-01-13T22:55:01.325ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102972025-01-13T22:55:01.325ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102982025-01-13T22:55:01.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102992025-01-13T22:55:01.325ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1bd62d11-89fb-471e-bf9b-c94f60202b5c", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
103002025-01-13T22:55:01.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 231.776178ms iteration = 25 status = {}
103012025-01-13T22:55:01.328ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
103022025-01-13T22:55:01.328ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
103032025-01-13T22:55:01.332ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103042025-01-13T22:55:01.332ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d92c769-bc78-4d39-8c6c-fddbb616c5ca", "content-length": "2", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
103052025-01-13T22:55:01.332ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103062025-01-13T22:55:01.332ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7edea35d-01c4-4af7-a37e-77a11ba11c74", "content-length": "51", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
103072025-01-13T22:55:01.332ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
103082025-01-13T22:55:01.332ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103092025-01-13T22:55:01.333ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
103102025-01-13T22:55:01.333ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
103112025-01-13T22:55:01.337ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
103122025-01-13T22:55:01.337ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b
103132025-01-13T22:55:01.344ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update sec_id = e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
103142025-01-13T22:55:01.344ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 94f43e5d-23a5-4698-935e-305c8373c95b saga_name = start-instance-update saga_result = SagaResult { saga_id: 94f43e5d-23a5-4698-935e-305c8373c95b, saga_log: SagaLog { saga_id: 94f43e5d-23a5-4698-935e-305c8373c95b, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("85f67aea-956c-4e94-8f1c-933c12c3dc9f")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("85f67aea-956c-4e94-8f1c-933c12c3dc9f")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("85f67aea-956c-4e94-8f1c-933c12c3dc9f"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("85f67aea-956c-4e94-8f1c-933c12c3dc9f")}} }) }
103152025-01-13T22:55:01.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103162025-01-13T22:55:01.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103172025-01-13T22:55:01.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103182025-01-13T22:55:01.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103192025-01-13T22:55:01.387ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103202025-01-13T22:55:01.428ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b6fd6b4c-ca03-4eb2-b6eb-a86e61aeba79", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
103212025-01-13T22:55:01.428ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
103222025-01-13T22:55:01.428ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103232025-01-13T22:55:01.428ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "396cbb84-7a53-48d6-b567-673b11476777", "content-length": "691", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
103242025-01-13T22:55:01.428ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103252025-01-13T22:55:01.428ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103262025-01-13T22:55:01.429ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103272025-01-13T22:55:01.429ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "598eabe4-6a9e-4619-84a4-8427f699b004", "content-length": "682", "date": "Mon, 13 Jan 2025 22:55:00 GMT"} })
103282025-01-13T22:55:01.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103292025-01-13T22:55:01.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103302025-01-13T22:55:01.430ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 193.121013ms iteration = 25 status = {}
103312025-01-13T22:55:01.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103322025-01-13T22:55:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103332025-01-13T22:55:01.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103342025-01-13T22:55:01.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103352025-01-13T22:55:01.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103362025-01-13T22:55:01.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103372025-01-13T22:55:01.444ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 377.874893ms iteration = 24 status = {}
103382025-01-13T22:55:01.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d88840bf-07f9-47a4-afe9-31cac016b877 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
103392025-01-13T22:55:01.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d88840bf-07f9-47a4-afe9-31cac016b877 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
103402025-01-13T22:55:01.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = d88840bf-07f9-47a4-afe9-31cac016b877 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
103412025-01-13T22:55:02.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1cb84a9f-3ee0-4298-940e-afabf19d47fc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103422025-01-13T22:55:02.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1cb84a9f-3ee0-4298-940e-afabf19d47fc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103432025-01-13T22:55:02.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 1cb84a9f-3ee0-4298-940e-afabf19d47fc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103442025-01-13T22:55:03.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97cea41b-7b0d-45c0-8f28-f02cc775da67 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103452025-01-13T22:55:03.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97cea41b-7b0d-45c0-8f28-f02cc775da67 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103462025-01-13T22:55:03.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 97cea41b-7b0d-45c0-8f28-f02cc775da67 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103472025-01-13T22:55:03.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 1e1af1d8-dcb2-4720-a996-3e4c8fd444d0 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
103482025-01-13T22:55:04.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = abce00ef-2692-474f-9bb5-47eb319d1b90 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103492025-01-13T22:55:04.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = abce00ef-2692-474f-9bb5-47eb319d1b90 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103502025-01-13T22:55:04.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = abce00ef-2692-474f-9bb5-47eb319d1b90 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103512025-01-13T22:55:05.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 16b8aa26-5b2e-4065-b6e8-53a858bf2110 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103522025-01-13T22:55:05.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 16b8aa26-5b2e-4065-b6e8-53a858bf2110 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103532025-01-13T22:55:05.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 16b8aa26-5b2e-4065-b6e8-53a858bf2110 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103542025-01-13T22:55:06.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f08fb748-e3c1-4514-bcd9-20a9d3e60cbb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103552025-01-13T22:55:06.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f08fb748-e3c1-4514-bcd9-20a9d3e60cbb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103562025-01-13T22:55:06.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f08fb748-e3c1-4514-bcd9-20a9d3e60cbb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103572025-01-13T22:55:07.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 996a60ae-2950-4272-a12e-7031b79ff8b9 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103582025-01-13T22:55:07.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 996a60ae-2950-4272-a12e-7031b79ff8b9 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103592025-01-13T22:55:07.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 996a60ae-2950-4272-a12e-7031b79ff8b9 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103602025-01-13T22:55:08.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 77be1c2f-efe2-40a2-abb1-92ea1c17eaa6 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103612025-01-13T22:55:08.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 77be1c2f-efe2-40a2-abb1-92ea1c17eaa6 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103622025-01-13T22:55:08.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 77be1c2f-efe2-40a2-abb1-92ea1c17eaa6 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103632025-01-13T22:55:09.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bff680de-64dd-4313-87bf-3a2f3afc609f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103642025-01-13T22:55:09.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bff680de-64dd-4313-87bf-3a2f3afc609f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103652025-01-13T22:55:09.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bff680de-64dd-4313-87bf-3a2f3afc609f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103662025-01-13T22:55:10.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2b8b30c2-1907-4150-a267-99b58c2b8dbb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103672025-01-13T22:55:10.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2b8b30c2-1907-4150-a267-99b58c2b8dbb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103682025-01-13T22:55:10.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2b8b30c2-1907-4150-a267-99b58c2b8dbb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103692025-01-13T22:55:11.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
103702025-01-13T22:55:11.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
103712025-01-13T22:55:11.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103722025-01-13T22:55:11.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103732025-01-13T22:55:11.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103742025-01-13T22:55:11.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103752025-01-13T22:55:11.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103762025-01-13T22:55:11.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103772025-01-13T22:55:11.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103782025-01-13T22:55:11.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.386507ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103792025-01-13T22:55:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103802025-01-13T22:55:11.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103812025-01-13T22:55:11.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103822025-01-13T22:55:11.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103832025-01-13T22:55:11.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103842025-01-13T22:55:11.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103852025-01-13T22:55:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
103862025-01-13T22:55:11.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103872025-01-13T22:55:11.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103882025-01-13T22:55:11.091ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
103892025-01-13T22:55:11.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.710797ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
103902025-01-13T22:55:11.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d715dd6e-06f1-46f6-97fc-cdbb35b2ee14 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103912025-01-13T22:55:11.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d715dd6e-06f1-46f6-97fc-cdbb35b2ee14 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103922025-01-13T22:55:11.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = d715dd6e-06f1-46f6-97fc-cdbb35b2ee14 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103932025-01-13T22:55:12.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 862a85d0-9351-4b56-ab06-19d3961cceec roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103942025-01-13T22:55:12.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 862a85d0-9351-4b56-ab06-19d3961cceec resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103952025-01-13T22:55:12.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 862a85d0-9351-4b56-ab06-19d3961cceec response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103962025-01-13T22:55:13.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 3abf3eca-ddd7-4048-b013-bb769932e3e3 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
103972025-01-13T22:55:13.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8662a5a0-a411-4f5b-ae6a-cc5fd007ef18 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103982025-01-13T22:55:13.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8662a5a0-a411-4f5b-ae6a-cc5fd007ef18 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
103992025-01-13T22:55:13.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8662a5a0-a411-4f5b-ae6a-cc5fd007ef18 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104002025-01-13T22:55:14.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e9f8dc9e-e5c9-44c1-a41b-9444b76abb31 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104012025-01-13T22:55:14.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e9f8dc9e-e5c9-44c1-a41b-9444b76abb31 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104022025-01-13T22:55:14.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e9f8dc9e-e5c9-44c1-a41b-9444b76abb31 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104032025-01-13T22:55:15.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 563a4a7c-be84-418c-883f-c97f2f0e9534 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104042025-01-13T22:55:15.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 563a4a7c-be84-418c-883f-c97f2f0e9534 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104052025-01-13T22:55:15.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 563a4a7c-be84-418c-883f-c97f2f0e9534 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104062025-01-13T22:55:16.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4319978-4002-463b-b2e0-473a102b2f37 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104072025-01-13T22:55:16.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4319978-4002-463b-b2e0-473a102b2f37 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104082025-01-13T22:55:16.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e4319978-4002-463b-b2e0-473a102b2f37 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104092025-01-13T22:55:17.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5a9e4a26-851a-4cb5-b85b-2b07f015612e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104102025-01-13T22:55:17.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5a9e4a26-851a-4cb5-b85b-2b07f015612e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104112025-01-13T22:55:17.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5a9e4a26-851a-4cb5-b85b-2b07f015612e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104122025-01-13T22:55:18.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cac281cc-818e-4f09-bfcd-2598855d3582 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104132025-01-13T22:55:18.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cac281cc-818e-4f09-bfcd-2598855d3582 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104142025-01-13T22:55:18.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = cac281cc-818e-4f09-bfcd-2598855d3582 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104152025-01-13T22:55:19.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7182c4ef-b690-4084-b185-86925564aad4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104162025-01-13T22:55:19.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7182c4ef-b690-4084-b185-86925564aad4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104172025-01-13T22:55:19.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7182c4ef-b690-4084-b185-86925564aad4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104182025-01-13T22:55:20.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 71027164-4489-475e-95dd-16ea33628f59 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104192025-01-13T22:55:20.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 71027164-4489-475e-95dd-16ea33628f59 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104202025-01-13T22:55:20.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 71027164-4489-475e-95dd-16ea33628f59 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104212025-01-13T22:55:21.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
104222025-01-13T22:55:21.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
104232025-01-13T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104242025-01-13T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104252025-01-13T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104262025-01-13T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104272025-01-13T22:55:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104282025-01-13T22:55:21.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104292025-01-13T22:55:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104302025-01-13T22:55:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104312025-01-13T22:55:21.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104322025-01-13T22:55:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104332025-01-13T22:55:21.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104342025-01-13T22:55:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104352025-01-13T22:55:21.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104362025-01-13T22:55:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
104372025-01-13T22:55:21.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104382025-01-13T22:55:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104392025-01-13T22:55:21.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
104402025-01-13T22:55:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.698463ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
104412025-01-13T22:55:21.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.83795ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104422025-01-13T22:55:21.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eb7ce306-f2e0-421f-b57a-97ab979b0519 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104432025-01-13T22:55:21.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eb7ce306-f2e0-421f-b57a-97ab979b0519 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104442025-01-13T22:55:21.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = eb7ce306-f2e0-421f-b57a-97ab979b0519 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104452025-01-13T22:55:22.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 696ea92b-fcd0-477f-8557-1bfe48e25924 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104462025-01-13T22:55:22.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 696ea92b-fcd0-477f-8557-1bfe48e25924 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104472025-01-13T22:55:22.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 696ea92b-fcd0-477f-8557-1bfe48e25924 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104482025-01-13T22:55:23.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 587 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 17f3e2e6-c6fa-4e4d-9eef-2a70c9138b07 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
104492025-01-13T22:55:23.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55e4d8cc-3548-4e6c-9bc0-6a42d0a97aab roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104502025-01-13T22:55:23.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55e4d8cc-3548-4e6c-9bc0-6a42d0a97aab resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104512025-01-13T22:55:23.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 55e4d8cc-3548-4e6c-9bc0-6a42d0a97aab response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104522025-01-13T22:55:24.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d36a15c-98c5-454a-ad5c-5d6068b70f46 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104532025-01-13T22:55:24.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d36a15c-98c5-454a-ad5c-5d6068b70f46 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104542025-01-13T22:55:24.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 8d36a15c-98c5-454a-ad5c-5d6068b70f46 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104552025-01-13T22:55:25.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9f4b632b-1454-45f9-b3a2-0d472f4f2663 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104562025-01-13T22:55:25.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9f4b632b-1454-45f9-b3a2-0d472f4f2663 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104572025-01-13T22:55:25.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9f4b632b-1454-45f9-b3a2-0d472f4f2663 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104582025-01-13T22:55:26.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 29bdbaa8-d88c-4f69-9ed0-f85e21e9915a roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104592025-01-13T22:55:26.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 29bdbaa8-d88c-4f69-9ed0-f85e21e9915a resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104602025-01-13T22:55:26.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 29bdbaa8-d88c-4f69-9ed0-f85e21e9915a response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104612025-01-13T22:55:27.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fea65a0-46f4-4f39-9be1-b98325c47cf4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104622025-01-13T22:55:27.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fea65a0-46f4-4f39-9be1-b98325c47cf4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104632025-01-13T22:55:27.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 7fea65a0-46f4-4f39-9be1-b98325c47cf4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104642025-01-13T22:55:28.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84d10fd7-2cea-4106-a8db-420e444981dd roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104652025-01-13T22:55:28.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84d10fd7-2cea-4106-a8db-420e444981dd resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104662025-01-13T22:55:28.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 84d10fd7-2cea-4106-a8db-420e444981dd response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104672025-01-13T22:55:29.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3a152ae7-98ed-44f2-9ee5-295ddc96e89f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104682025-01-13T22:55:29.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3a152ae7-98ed-44f2-9ee5-295ddc96e89f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104692025-01-13T22:55:29.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 3a152ae7-98ed-44f2-9ee5-295ddc96e89f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104702025-01-13T22:55:30.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e33cbb2c-50dd-4289-a12c-ebbafb496398 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104712025-01-13T22:55:30.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e33cbb2c-50dd-4289-a12c-ebbafb496398 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104722025-01-13T22:55:30.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e33cbb2c-50dd-4289-a12c-ebbafb496398 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
104732025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
104742025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
104752025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
104762025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
104772025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104782025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104792025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
104802025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
104812025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
104822025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104832025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
104842025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
104852025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104862025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104872025-01-13T22:55:31.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104882025-01-13T22:55:31.066ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c912cdb2-0bf8-4986-aea6-c21134511a15.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4c35da2-31ab-4a52-ae76-9faa2bfde5ff.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 3390, tv_nsec: 695168928 } })
104892025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
104902025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
104912025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104922025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
104932025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
104942025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
104952025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104962025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
104972025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
104982025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104992025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105002025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
105012025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105022025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
105032025-01-13T22:55:31.066ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-13 22:45:31.066200830 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105042025-01-13T22:55:31.066ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("703734af-afe4-469d-918d-477e69023a5c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e682b62b-457a-4c56-8f10-146a56a0b849.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea1c6c62-6b91-4c2e-b341-59c749f0e249.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3390, tv_nsec: 695375325 } })
105052025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105062025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
105072025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105082025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
105092025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105102025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
105112025-01-13T22:55:31.066ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
105122025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105132025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
105142025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105152025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
105162025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105172025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
105182025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105192025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
105202025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
105212025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
105222025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
105232025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105242025-01-13T22:55:31.066ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f
105252025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.641\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f"}
105262025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
105272025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
105282025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105292025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105302025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
105312025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105322025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105332025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
105342025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
105352025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105362025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105372025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
105382025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105392025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105402025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105412025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105422025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105432025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105442025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105452025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105462025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105472025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105482025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105492025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105502025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105512025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105522025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
105532025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105542025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.500767ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
105552025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
105562025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105572025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.505998ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
105582025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105592025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105602025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
105612025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105622025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105632025-01-13T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105642025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105652025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105662025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105672025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105682025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105692025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105702025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105712025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105722025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105732025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105742025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105752025-01-13T22:55:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105762025-01-13T22:55:31.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105772025-01-13T22:55:31.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105782025-01-13T22:55:31.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105792025-01-13T22:55:31.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105802025-01-13T22:55:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105812025-01-13T22:55:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
105822025-01-13T22:55:31.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105832025-01-13T22:55:31.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105842025-01-13T22:55:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.434411ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105852025-01-13T22:55:31.072ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.503394ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
105862025-01-13T22:55:31.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105872025-01-13T22:55:31.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3390, tv_nsec: 702991874 } })
105882025-01-13T22:55:31.074ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
105892025-01-13T22:55:31.074ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-13 22:45:31.066200830 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105902025-01-13T22:55:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.091965ms iteration = 13 status = {"expiration":"2025-01-13T22:45:31.066200830Z","pruned":[]}
105912025-01-13T22:55:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105922025-01-13T22:55:31.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105932025-01-13T22:55:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105942025-01-13T22:55:31.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.251152ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
105952025-01-13T22:55:31.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3390, tv_nsec: 706040890 } })
105962025-01-13T22:55:31.076ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105972025-01-13T22:55:31.077ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105982025-01-13T22:55:31.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105992025-01-13T22:55:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106002025-01-13T22:55:31.078ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106012025-01-13T22:55:31.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106022025-01-13T22:55:31.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106032025-01-13T22:55:31.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106042025-01-13T22:55:31.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106052025-01-13T22:55:31.080ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
106062025-01-13T22:55:31.080ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
106072025-01-13T22:55:31.080ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.61891ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
106082025-01-13T22:55:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106092025-01-13T22:55:31.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106102025-01-13T22:55:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106112025-01-13T22:55:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106122025-01-13T22:55:31.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106132025-01-13T22:55:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106142025-01-13T22:55:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106152025-01-13T22:55:31.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106162025-01-13T22:55:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106172025-01-13T22:55:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106182025-01-13T22:55:31.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106192025-01-13T22:55:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106202025-01-13T22:55:31.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106212025-01-13T22:55:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106222025-01-13T22:55:31.087ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106232025-01-13T22:55:31.087ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106242025-01-13T22:55:31.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106252025-01-13T22:55:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106262025-01-13T22:55:31.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106272025-01-13T22:55:31.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106282025-01-13T22:55:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106292025-01-13T22:55:31.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106302025-01-13T22:55:31.096ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
106312025-01-13T22:55:31.096ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106322025-01-13T22:55:31.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106332025-01-13T22:55:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106342025-01-13T22:55:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106352025-01-13T22:55:31.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106362025-01-13T22:55:31.098ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106372025-01-13T22:55:31.099ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106382025-01-13T22:55:31.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106392025-01-13T22:55:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106402025-01-13T22:55:31.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3390, tv_nsec: 729278261 } })
106412025-01-13T22:55:31.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106422025-01-13T22:55:31.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
106432025-01-13T22:55:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106442025-01-13T22:55:31.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106452025-01-13T22:55:31.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106462025-01-13T22:55:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106472025-01-13T22:55:31.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106482025-01-13T22:55:31.104ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106492025-01-13T22:55:31.104ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 38.083608ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106502025-01-13T22:55:31.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106512025-01-13T22:55:31.108ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106522025-01-13T22:55:31.108ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106532025-01-13T22:55:31.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106542025-01-13T22:55:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106552025-01-13T22:55:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106562025-01-13T22:55:31.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106572025-01-13T22:55:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106582025-01-13T22:55:31.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106592025-01-13T22:55:31.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106602025-01-13T22:55:31.115ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106612025-01-13T22:55:31.115ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106622025-01-13T22:55:31.115ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 48.763223ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106632025-01-13T22:55:31.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106642025-01-13T22:55:31.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106652025-01-13T22:55:31.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106662025-01-13T22:55:31.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106672025-01-13T22:55:31.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106682025-01-13T22:55:31.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106692025-01-13T22:55:31.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106702025-01-13T22:55:31.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106712025-01-13T22:55:31.122ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106722025-01-13T22:55:31.124ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106732025-01-13T22:55:31.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106742025-01-13T22:55:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106752025-01-13T22:55:31.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106762025-01-13T22:55:31.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.201103ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106772025-01-13T22:55:31.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106782025-01-13T22:55:31.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106792025-01-13T22:55:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106802025-01-13T22:55:31.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 62.147514ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
106812025-01-13T22:55:31.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106822025-01-13T22:55:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106832025-01-13T22:55:31.131ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106842025-01-13T22:55:31.132ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
106852025-01-13T22:55:31.132ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
106862025-01-13T22:55:31.132ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
106872025-01-13T22:55:31.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106882025-01-13T22:55:31.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.386538ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
106892025-01-13T22:55:31.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106902025-01-13T22:55:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
106912025-01-13T22:55:31.133ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106922025-01-13T22:55:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106932025-01-13T22:55:31.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106942025-01-13T22:55:31.142ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106952025-01-13T22:55:31.142ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106962025-01-13T22:55:31.142ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.674021ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
106972025-01-13T22:55:31.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106982025-01-13T22:55:31.143ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
106992025-01-13T22:55:31.143ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107002025-01-13T22:55:31.143ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107012025-01-13T22:55:31.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107022025-01-13T22:55:31.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107032025-01-13T22:55:31.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
107042025-01-13T22:55:31.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107052025-01-13T22:55:31.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107062025-01-13T22:55:31.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107072025-01-13T22:55:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107082025-01-13T22:55:31.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107092025-01-13T22:55:31.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107102025-01-13T22:55:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107112025-01-13T22:55:31.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107122025-01-13T22:55:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107132025-01-13T22:55:31.148ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107142025-01-13T22:55:31.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107152025-01-13T22:55:31.150ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107162025-01-13T22:55:31.150ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
107172025-01-13T22:55:31.150ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
107182025-01-13T22:55:31.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107192025-01-13T22:55:31.151ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107202025-01-13T22:55:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107212025-01-13T22:55:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107222025-01-13T22:55:31.152ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107232025-01-13T22:55:31.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107242025-01-13T22:55:31.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107252025-01-13T22:55:31.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107262025-01-13T22:55:31.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107272025-01-13T22:55:31.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107282025-01-13T22:55:31.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107292025-01-13T22:55:31.154ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 87.937386ms iteration = 6 status = {"nsuccess":5}
107302025-01-13T22:55:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107312025-01-13T22:55:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107322025-01-13T22:55:31.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107332025-01-13T22:55:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107342025-01-13T22:55:31.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107352025-01-13T22:55:31.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107362025-01-13T22:55:31.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107372025-01-13T22:55:31.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107382025-01-13T22:55:31.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107392025-01-13T22:55:31.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107402025-01-13T22:55:31.158ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 04014b26-39f2-4441-adc5-e1391f6e7dd1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
107412025-01-13T22:55:31.158ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
107422025-01-13T22:55:31.158ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-13 22:44:13.434255 UTC dns_group = internal generation = 1
107432025-01-13T22:55:31.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 93.526871ms iteration = 13 status = {"generation":1}
107442025-01-13T22:55:31.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.288193ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107452025-01-13T22:55:31.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107462025-01-13T22:55:31.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107472025-01-13T22:55:31.160ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
107482025-01-13T22:55:31.160ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.779659ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
107492025-01-13T22:55:31.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107502025-01-13T22:55:31.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107512025-01-13T22:55:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
107522025-01-13T22:55:31.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107532025-01-13T22:55:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107542025-01-13T22:55:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107552025-01-13T22:55:31.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.389614ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107562025-01-13T22:55:31.165ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.242831ms iteration = 25 status = 0
107572025-01-13T22:55:31.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107582025-01-13T22:55:31.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107592025-01-13T22:55:31.167ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107602025-01-13T22:55:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
107612025-01-13T22:55:31.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107622025-01-13T22:55:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107632025-01-13T22:55:31.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107642025-01-13T22:55:31.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107652025-01-13T22:55:31.174ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.768739ms iteration = 28 status = {"physical_disks_added":0}
107662025-01-13T22:55:31.179ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107672025-01-13T22:55:31.179ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 0 version = 2
107682025-01-13T22:55:31.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107692025-01-13T22:55:31.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107702025-01-13T22:55:31.192ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107712025-01-13T22:55:31.193ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-13T22:43:26.910735Z, time_modified: 2025-01-13T22:43:26.910735Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, db_silo: Silo { identity: SiloIdentity { id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-13T22:44:14.393717Z, time_modified: 2025-01-13T22:44:14.393717Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
107722025-01-13T22:55:31.193ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 128.282113ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]}},"default_endpoint":{"silo_id":"79ea48a0-40b4-4832-a95d-b4390d7ce4ec","tls_certs":["dfe074fb76632a643b6e8f68a2b05af4792f907108b73577d17ecd024c16318c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
107732025-01-13T22:55:31.223ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107742025-01-13T22:55:31.223ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107752025-01-13T22:55:31.223ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08cbb7f5-cdba-41a0-8efe-ac94526e348c", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
107762025-01-13T22:55:31.223ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107772025-01-13T22:55:31.225ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107782025-01-13T22:55:31.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
107792025-01-13T22:55:31.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107802025-01-13T22:55:31.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107812025-01-13T22:55:31.253ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
107822025-01-13T22:55:31.253ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107832025-01-13T22:55:31.253ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "527f0da4-f5a6-446c-af5b-cf6e612414f3", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
107842025-01-13T22:55:31.253ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107852025-01-13T22:55:31.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
107862025-01-13T22:55:31.315ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
107872025-01-13T22:55:31.331ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107882025-01-13T22:55:31.331ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107892025-01-13T22:55:31.331ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dbf8964-4108-4080-8470-14628104db7b", "content-length": "372", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} })
107902025-01-13T22:55:31.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107912025-01-13T22:55:31.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107922025-01-13T22:55:31.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107932025-01-13T22:55:31.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107942025-01-13T22:55:31.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107952025-01-13T22:55:31.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107962025-01-13T22:55:31.339ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8b871052-604f-494f-8a75-1da82bcc503b dns_zone_name = oxide.test found_so_far = 1 version = 2
107972025-01-13T22:55:31.339ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107982025-01-13T22:55:31.339ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-13 22:44:14.564029 UTC dns_group = external generation = 2
107992025-01-13T22:55:31.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 273.968985ms iteration = 13 status = {"generation":2}
108002025-01-13T22:55:31.368ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
108012025-01-13T22:55:31.368ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 302.162281ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
108022025-01-13T22:55:31.369ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
108032025-01-13T22:55:31.376ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
108042025-01-13T22:55:31.376ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108052025-01-13T22:55:31.376ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f315ef70-1787-43b4-9acd-d2c0996fc708", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} })
108062025-01-13T22:55:31.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108072025-01-13T22:55:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108082025-01-13T22:55:31.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108092025-01-13T22:55:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108102025-01-13T22:55:31.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108112025-01-13T22:55:31.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108122025-01-13T22:55:31.385ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108132025-01-13T22:55:31.385ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108142025-01-13T22:55:31.385ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "747ffd7c-4024-4a57-9e13-4278c201172c", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} })
108152025-01-13T22:55:31.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108162025-01-13T22:55:31.386ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108172025-01-13T22:55:31.386ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c30335b-2228-46e2-8afa-937ca5867f67", "content-length": "26", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
108182025-01-13T22:55:31.386ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108192025-01-13T22:55:31.387ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.367182ms iteration = 26 status = {}
108202025-01-13T22:55:31.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108212025-01-13T22:55:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 330.603346ms iteration = 25 status = {}
108222025-01-13T22:55:31.423ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
108232025-01-13T22:55:31.423ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 356.947094ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
108242025-01-13T22:55:31.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108252025-01-13T22:55:31.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108262025-01-13T22:55:31.439ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108272025-01-13T22:55:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108282025-01-13T22:55:31.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108292025-01-13T22:55:31.442ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108302025-01-13T22:55:31.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108312025-01-13T22:55:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108322025-01-13T22:55:31.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108332025-01-13T22:55:31.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108342025-01-13T22:55:31.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108352025-01-13T22:55:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108362025-01-13T22:55:31.520ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108372025-01-13T22:55:31.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "93cf82de-8765-4d43-8f6a-b67db9482a60", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108382025-01-13T22:55:31.520ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108392025-01-13T22:55:31.522ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d3e1f63c-f535-43d6-9ec6-3aefcd5f5e10", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108402025-01-13T22:55:31.522ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108412025-01-13T22:55:31.524ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "15e5e3a5-cf26-4086-ac39-cb982fba5b60", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108422025-01-13T22:55:31.524ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108432025-01-13T22:55:31.526ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108442025-01-13T22:55:31.526ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 460.863442ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108452025-01-13T22:55:31.570ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108462025-01-13T22:55:31.570ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "08a4d361-b600-4f9a-8e15-bd0223806f1e", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108472025-01-13T22:55:31.570ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108482025-01-13T22:55:31.572ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c3768282-094a-4e2c-bd44-9c867eb57e1b", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108492025-01-13T22:55:31.572ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108502025-01-13T22:55:31.573ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108512025-01-13T22:55:31.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 508.239402ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108522025-01-13T22:55:31.582ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108532025-01-13T22:55:31.582ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dee29c2-5559-415e-9908-8ccba5e96ec2", "content-length": "691", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} })
108542025-01-13T22:55:31.582ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
108552025-01-13T22:55:31.582ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
108562025-01-13T22:55:31.582ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
108572025-01-13T22:55:31.583ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 345.492344ms iteration = 26 status = {}
108582025-01-13T22:55:31.596ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108592025-01-13T22:55:31.596ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "92642515-5ab4-4e5f-88b3-c1d65ef1bd24", "content-length": "2", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
108602025-01-13T22:55:31.598ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108612025-01-13T22:55:31.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108622025-01-13T22:55:31.601ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 534.89192ms iteration = 25 status = null
108632025-01-13T22:55:31.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108642025-01-13T22:55:31.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108652025-01-13T22:55:31.607ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
108662025-01-13T22:55:31.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108672025-01-13T22:55:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108682025-01-13T22:55:31.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
108692025-01-13T22:55:31.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbde0aec-41ac-497b-abc3-8e1731b34f31", "content-length": "134", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
108702025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108712025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
108722025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108732025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108742025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108752025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108762025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108772025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108782025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108792025-01-13T22:55:31.618ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108802025-01-13T22:55:31.619ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
108812025-01-13T22:55:31.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108822025-01-13T22:55:31.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108832025-01-13T22:55:31.620ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
108842025-01-13T22:55:31.620ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b146d419-4937-4ee0-8c96-35304f27a884", "content-length": "2", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
108852025-01-13T22:55:31.620ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
108862025-01-13T22:55:31.620ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "522cf7b3-363d-4b56-8bb8-ecba1588ec50", "content-length": "51", "date": "Mon, 13 Jan 2025 22:55:30 GMT"} })
108872025-01-13T22:55:31.620ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
108882025-01-13T22:55:31.620ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
108892025-01-13T22:55:31.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 1dd14f60-9a05-445c-9e9a-21a7aefbfe39 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
108902025-01-13T22:55:31.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 1dd14f60-9a05-445c-9e9a-21a7aefbfe39 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
108912025-01-13T22:55:31.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = 1dd14f60-9a05-445c-9e9a-21a7aefbfe39 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
108922025-01-13T22:55:31.712ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8ee266fb-b7de-4c82-a456-bc9331f5b2c4", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} })
108932025-01-13T22:55:31.712ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
108942025-01-13T22:55:31.712ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108952025-01-13T22:55:31.712ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "12f0ccfa-c584-4ea9-a600-7b2351cb0839", "content-length": "682", "date": "Mon, 13 Jan 2025 22:55:31 GMT"} })
108962025-01-13T22:55:31.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108972025-01-13T22:55:31.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108982025-01-13T22:55:31.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108992025-01-13T22:55:31.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109002025-01-13T22:55:31.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109012025-01-13T22:55:31.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109022025-01-13T22:55:31.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109032025-01-13T22:55:31.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109042025-01-13T22:55:31.729ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.628148ms iteration = 25 status = {}
109052025-01-13T22:55:31.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 08aa3abd-59fb-494a-9cb1-da5ecaa92bf7 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109062025-01-13T22:55:31.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 08aa3abd-59fb-494a-9cb1-da5ecaa92bf7 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109072025-01-13T22:55:31.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 08aa3abd-59fb-494a-9cb1-da5ecaa92bf7 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109082025-01-13T22:55:32.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 343cb180-4f72-47fa-a236-ef78fba46758 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109092025-01-13T22:55:32.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 343cb180-4f72-47fa-a236-ef78fba46758 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109102025-01-13T22:55:32.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 343cb180-4f72-47fa-a236-ef78fba46758 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109112025-01-13T22:55:33.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 610 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = aa90e467-4da4-4512-97e6-b330586a0540 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
109122025-01-13T22:55:33.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3fd31c9-b697-4a37-922b-e18075b5bd5d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109132025-01-13T22:55:33.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3fd31c9-b697-4a37-922b-e18075b5bd5d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109142025-01-13T22:55:33.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a3fd31c9-b697-4a37-922b-e18075b5bd5d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109152025-01-13T22:55:35.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5fd5617c-152d-4c67-9723-5e6b44680741 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109162025-01-13T22:55:35.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5fd5617c-152d-4c67-9723-5e6b44680741 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109172025-01-13T22:55:35.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5fd5617c-152d-4c67-9723-5e6b44680741 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109182025-01-13T22:55:36.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5b0ae811-a8cb-4e85-8a9f-9851a4ccebef roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109192025-01-13T22:55:36.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5b0ae811-a8cb-4e85-8a9f-9851a4ccebef resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109202025-01-13T22:55:36.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5b0ae811-a8cb-4e85-8a9f-9851a4ccebef response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109212025-01-13T22:55:37.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 89ee1500-08b0-4743-a177-a405428c6e7f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109222025-01-13T22:55:37.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 89ee1500-08b0-4743-a177-a405428c6e7f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109232025-01-13T22:55:37.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 89ee1500-08b0-4743-a177-a405428c6e7f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109242025-01-13T22:55:38.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41167e52-62c0-48ce-af67-5ed4ac91fa53 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109252025-01-13T22:55:38.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41167e52-62c0-48ce-af67-5ed4ac91fa53 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109262025-01-13T22:55:38.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 41167e52-62c0-48ce-af67-5ed4ac91fa53 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109272025-01-13T22:55:39.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50355640-971e-4fd4-865e-0131e655c54f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109282025-01-13T22:55:39.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50355640-971e-4fd4-865e-0131e655c54f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109292025-01-13T22:55:39.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 50355640-971e-4fd4-865e-0131e655c54f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109302025-01-13T22:55:40.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 813a16b3-9a8e-4178-8fd1-ac3866a32c97 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109312025-01-13T22:55:40.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 813a16b3-9a8e-4178-8fd1-ac3866a32c97 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109322025-01-13T22:55:40.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 813a16b3-9a8e-4178-8fd1-ac3866a32c97 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109332025-01-13T22:55:41.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
109342025-01-13T22:55:41.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109352025-01-13T22:55:41.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
109362025-01-13T22:55:41.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109372025-01-13T22:55:41.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109382025-01-13T22:55:41.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109392025-01-13T22:55:41.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109402025-01-13T22:55:41.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109412025-01-13T22:55:41.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109422025-01-13T22:55:41.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109432025-01-13T22:55:41.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109442025-01-13T22:55:41.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109452025-01-13T22:55:41.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109462025-01-13T22:55:41.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
109472025-01-13T22:55:41.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109482025-01-13T22:55:41.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109492025-01-13T22:55:41.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
109502025-01-13T22:55:41.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.859025ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
109512025-01-13T22:55:41.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109522025-01-13T22:55:41.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109532025-01-13T22:55:41.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.902592ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109542025-01-13T22:55:41.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = be152365-3015-44b1-8a65-a5e78aced0d2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109552025-01-13T22:55:41.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = be152365-3015-44b1-8a65-a5e78aced0d2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109562025-01-13T22:55:41.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = be152365-3015-44b1-8a65-a5e78aced0d2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109572025-01-13T22:55:42.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0b67a9c3-cb6c-4011-b8f5-6261d884e453 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109582025-01-13T22:55:42.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0b67a9c3-cb6c-4011-b8f5-6261d884e453 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109592025-01-13T22:55:42.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0b67a9c3-cb6c-4011-b8f5-6261d884e453 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109602025-01-13T22:55:43.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb9503d9-86bc-4109-af66-ed8eb36381c0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109612025-01-13T22:55:43.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb9503d9-86bc-4109-af66-ed8eb36381c0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109622025-01-13T22:55:43.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = bb9503d9-86bc-4109-af66-ed8eb36381c0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109632025-01-13T22:55:43.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 615 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 928f6854-91e6-49a4-b93d-6f82aaec4517 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
109642025-01-13T22:55:44.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ecb1cc2a-dc21-40ff-a204-4e85c8b513d8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109652025-01-13T22:55:44.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ecb1cc2a-dc21-40ff-a204-4e85c8b513d8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109662025-01-13T22:55:44.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = ecb1cc2a-dc21-40ff-a204-4e85c8b513d8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109672025-01-13T22:55:45.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9927b486-8fab-47a4-8b47-abf9b002db80 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109682025-01-13T22:55:45.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9927b486-8fab-47a4-8b47-abf9b002db80 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109692025-01-13T22:55:45.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9927b486-8fab-47a4-8b47-abf9b002db80 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109702025-01-13T22:55:46.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a9808b8a-14ec-4bc3-80b1-51b131dd2756 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109712025-01-13T22:55:46.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a9808b8a-14ec-4bc3-80b1-51b131dd2756 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109722025-01-13T22:55:46.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = a9808b8a-14ec-4bc3-80b1-51b131dd2756 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109732025-01-13T22:55:47.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f252b46-9bc7-41df-860d-13cac4922680 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109742025-01-13T22:55:47.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f252b46-9bc7-41df-860d-13cac4922680 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109752025-01-13T22:55:47.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 0f252b46-9bc7-41df-860d-13cac4922680 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109762025-01-13T22:55:48.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9dd2261a-1018-40d6-8c21-cad08fa21d1c roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109772025-01-13T22:55:48.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9dd2261a-1018-40d6-8c21-cad08fa21d1c resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109782025-01-13T22:55:48.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9dd2261a-1018-40d6-8c21-cad08fa21d1c response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109792025-01-13T22:55:49.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 82b70336-8100-44c8-a48d-0fc19df5da1d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109802025-01-13T22:55:49.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 82b70336-8100-44c8-a48d-0fc19df5da1d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109812025-01-13T22:55:49.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 82b70336-8100-44c8-a48d-0fc19df5da1d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109822025-01-13T22:55:50.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 66be4d35-059b-405f-a2b5-86d92c202898 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109832025-01-13T22:55:50.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 66be4d35-059b-405f-a2b5-86d92c202898 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109842025-01-13T22:55:50.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 66be4d35-059b-405f-a2b5-86d92c202898 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
109852025-01-13T22:55:51.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
109862025-01-13T22:55:51.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
109872025-01-13T22:55:51.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109882025-01-13T22:55:51.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109892025-01-13T22:55:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109902025-01-13T22:55:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109912025-01-13T22:55:51.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109922025-01-13T22:55:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109932025-01-13T22:55:51.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109942025-01-13T22:55:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109952025-01-13T22:55:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109962025-01-13T22:55:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109972025-01-13T22:55:51.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109982025-01-13T22:55:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
109992025-01-13T22:55:51.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110002025-01-13T22:55:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110012025-01-13T22:55:51.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
110022025-01-13T22:55:51.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.811598ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
110032025-01-13T22:55:51.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110042025-01-13T22:55:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110052025-01-13T22:55:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.578394ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110062025-01-13T22:55:51.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2cab0bc6-a370-4344-87f7-12004c26c817 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110072025-01-13T22:55:51.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2cab0bc6-a370-4344-87f7-12004c26c817 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110082025-01-13T22:55:51.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 2cab0bc6-a370-4344-87f7-12004c26c817 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110092025-01-13T22:55:52.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e2f0d253-246a-442f-b136-f1678cbc29e8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110102025-01-13T22:55:52.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e2f0d253-246a-442f-b136-f1678cbc29e8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110112025-01-13T22:55:52.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e2f0d253-246a-442f-b136-f1678cbc29e8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110122025-01-13T22:55:53.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 10088a20-fa68-4f47-9445-d3996bf679e1 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110132025-01-13T22:55:53.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 10088a20-fa68-4f47-9445-d3996bf679e1 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110142025-01-13T22:55:53.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 10088a20-fa68-4f47-9445-d3996bf679e1 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110152025-01-13T22:55:53.506ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = 35ed6508-7b99-49df-b4d7-07c5e9e5eec6 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
110162025-01-13T22:55:54.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9219b2a2-1300-4cdd-9cef-31977eafdab4 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110172025-01-13T22:55:54.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9219b2a2-1300-4cdd-9cef-31977eafdab4 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110182025-01-13T22:55:54.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9219b2a2-1300-4cdd-9cef-31977eafdab4 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110192025-01-13T22:55:55.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5179c45c-8494-4fda-aecf-834ed2cca7bb roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110202025-01-13T22:55:55.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5179c45c-8494-4fda-aecf-834ed2cca7bb resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110212025-01-13T22:55:55.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5179c45c-8494-4fda-aecf-834ed2cca7bb response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110222025-01-13T22:55:56.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d39f455-52db-4919-8b4c-1934972fb6c2 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110232025-01-13T22:55:56.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d39f455-52db-4919-8b4c-1934972fb6c2 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110242025-01-13T22:55:56.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 9d39f455-52db-4919-8b4c-1934972fb6c2 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110252025-01-13T22:55:57.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e733d906-8346-4c7b-aa24-29d26a49f59f roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110262025-01-13T22:55:57.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e733d906-8346-4c7b-aa24-29d26a49f59f resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110272025-01-13T22:55:57.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = e733d906-8346-4c7b-aa24-29d26a49f59f response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110282025-01-13T22:55:58.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 98c236eb-be1d-4460-bcc0-6054f32c5b16 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110292025-01-13T22:55:58.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 98c236eb-be1d-4460-bcc0-6054f32c5b16 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110302025-01-13T22:55:58.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 98c236eb-be1d-4460-bcc0-6054f32c5b16 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110312025-01-13T22:55:59.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = de48e010-e3c5-4ee9-8fa1-e8bfb22d2093 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110322025-01-13T22:55:59.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = de48e010-e3c5-4ee9-8fa1-e8bfb22d2093 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110332025-01-13T22:55:59.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = de48e010-e3c5-4ee9-8fa1-e8bfb22d2093 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110342025-01-13T22:56:00.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9da5ddc-8fd4-44d5-b8ee-7b3e1ecdceb8 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110352025-01-13T22:56:00.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9da5ddc-8fd4-44d5-b8ee-7b3e1ecdceb8 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110362025-01-13T22:56:00.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f9da5ddc-8fd4-44d5-b8ee-7b3e1ecdceb8 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
110372025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
110382025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
110392025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
110402025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110412025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110422025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110432025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
110442025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110452025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
110462025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
110472025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110482025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110492025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
110502025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110512025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
110522025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110532025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110542025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
110552025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110562025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
110572025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110582025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
110592025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110602025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
110612025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110622025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
110632025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
110642025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
110652025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
110662025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
110672025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110682025-01-13T22:56:01.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110692025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110702025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110712025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110722025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110732025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110742025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110752025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110762025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110772025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
110782025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110792025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110802025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110812025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110822025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110832025-01-13T22:56:01.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110842025-01-13T22:56:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110852025-01-13T22:56:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110862025-01-13T22:56:01.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110872025-01-13T22:56:01.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110882025-01-13T22:56:01.070ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.417297ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110892025-01-13T22:56:01.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110902025-01-13T22:56:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110912025-01-13T22:56:01.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110922025-01-13T22:56:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110932025-01-13T22:56:01.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110942025-01-13T22:56:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110952025-01-13T22:56:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110962025-01-13T22:56:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110972025-01-13T22:56:01.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110982025-01-13T22:56:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110992025-01-13T22:56:01.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111002025-01-13T22:56:01.075ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111012025-01-13T22:56:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111022025-01-13T22:56:01.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111032025-01-13T22:56:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111042025-01-13T22:56:01.076ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111052025-01-13T22:56:01.076ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111062025-01-13T22:56:01.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111072025-01-13T22:56:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111082025-01-13T22:56:01.076ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3420, tv_nsec: 706057451 } })
111092025-01-13T22:56:01.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
111102025-01-13T22:56:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111112025-01-13T22:56:01.076ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111122025-01-13T22:56:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111132025-01-13T22:56:01.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111142025-01-13T22:56:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111152025-01-13T22:56:01.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111162025-01-13T22:56:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111172025-01-13T22:56:01.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3420, tv_nsec: 709437697 } })
111182025-01-13T22:56:01.080ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
111192025-01-13T22:56:01.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111202025-01-13T22:56:01.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111212025-01-13T22:56:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111222025-01-13T22:56:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111232025-01-13T22:56:01.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-bd8d50a3-f530-430e-8ded-11b6657cae3b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3420, tv_nsec: 711963626 } })
111242025-01-13T22:56:01.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
111252025-01-13T22:56:01.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111262025-01-13T22:56:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111272025-01-13T22:56:01.095ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
111282025-01-13T22:56:01.095ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
111292025-01-13T22:56:01.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111302025-01-13T22:56:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111312025-01-13T22:56:01.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111322025-01-13T22:56:01.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111332025-01-13T22:56:01.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111342025-01-13T22:56:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111352025-01-13T22:56:01.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.141298ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111362025-01-13T22:56:01.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111372025-01-13T22:56:01.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111382025-01-13T22:56:01.111ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111392025-01-13T22:56:01.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111402025-01-13T22:56:01.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111412025-01-13T22:56:01.114ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111422025-01-13T22:56:01.115ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111432025-01-13T22:56:01.115ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111442025-01-13T22:56:01.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111452025-01-13T22:56:01.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111462025-01-13T22:56:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: bd8d50a3-f530-430e-8ded-11b6657cae3b, lookup_type: ById(bd8d50a3-f530-430e-8ded-11b6657cae3b) } result = Ok(())
111472025-01-13T22:56:01.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111482025-01-13T22:56:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111492025-01-13T22:56:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111502025-01-13T22:56:01.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111512025-01-13T22:56:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111522025-01-13T22:56:01.118ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111532025-01-13T22:56:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111542025-01-13T22:56:01.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111552025-01-13T22:56:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111562025-01-13T22:56:01.121ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.6851ms iteration = 26 status = 0
111572025-01-13T22:56:01.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.729601ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
111582025-01-13T22:56:01.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.029304ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
111592025-01-13T22:56:01.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111602025-01-13T22:56:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111612025-01-13T22:56:01.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111622025-01-13T22:56:01.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111632025-01-13T22:56:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111642025-01-13T22:56:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 54e4f445-9a29-48a0-aea7-179cd2573e5f, lookup_type: ById(54e4f445-9a29-48a0-aea7-179cd2573e5f) } result = Ok(())
111652025-01-13T22:56:01.130ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111662025-01-13T22:56:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111672025-01-13T22:56:01.134ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111682025-01-13T22:56:01.134ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.502923ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111692025-01-13T22:56:01.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f original_time_created = 2025-01-13 22:43:22.791608 UTC target_id = 54e4f445-9a29-48a0-aea7-179cd2573e5f time_created = 2025-01-13 22:43:22.791608 UTC
111702025-01-13T22:56:01.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.551751ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"54e4f445-9a29-48a0-aea7-179cd2573e5f","time_created":"2025-01-13T22:43:22.791608Z"}
111712025-01-13T22:56:01.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111722025-01-13T22:56:01.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111732025-01-13T22:56:01.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111742025-01-13T22:56:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111752025-01-13T22:56:01.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111762025-01-13T22:56:01.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111772025-01-13T22:56:01.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111782025-01-13T22:56:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111792025-01-13T22:56:01.152ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111802025-01-13T22:56:01.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111812025-01-13T22:56:01.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.592695ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111822025-01-13T22:56:01.157ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111832025-01-13T22:56:01.157ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
111842025-01-13T22:56:01.157ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.589959ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
111852025-01-13T22:56:01.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.421057ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111862025-01-13T22:56:01.161ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:358
111872025-01-13T22:56:01.161ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 94.662856ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
111882025-01-13T22:56:01.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111892025-01-13T22:56:01.180ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111902025-01-13T22:56:01.181ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d660530-4b3e-4c28-8a09-cd937a97a642", "content-length": "26", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
111912025-01-13T22:56:01.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111922025-01-13T22:56:01.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111932025-01-13T22:56:01.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.791669ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
111942025-01-13T22:56:01.226ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.343982ms iteration = 29 status = {"physical_disks_added":0}
111952025-01-13T22:56:01.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
111962025-01-13T22:56:01.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111972025-01-13T22:56:01.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111982025-01-13T22:56:01.261ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111992025-01-13T22:56:01.261ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112002025-01-13T22:56:01.262ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfa3f672-1d08-4cba-8d13-4792ce60fb82", "content-length": "26", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112012025-01-13T22:56:01.262ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112022025-01-13T22:56:01.263ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112032025-01-13T22:56:01.273ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112042025-01-13T22:56:01.273ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112052025-01-13T22:56:01.274ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ac1a6fb-2f6f-4e57-9966-e4b34b22d21b", "content-length": "372", "date": "Mon, 13 Jan 2025 22:56:01 GMT"} })
112062025-01-13T22:56:01.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112072025-01-13T22:56:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112082025-01-13T22:56:01.285ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 zone_address = fd00:1122:3344:101::2
112092025-01-13T22:56:01.285ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112102025-01-13T22:56:01.285ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8bcf182-eec0-40bb-8a87-381de5fb799f", "content-length": "26", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112112025-01-13T22:56:01.285ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112122025-01-13T22:56:01.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
112132025-01-13T22:56:01.299ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 233.149841ms iteration = 26 status = {}
112142025-01-13T22:56:01.313ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
112152025-01-13T22:56:01.313ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
112162025-01-13T22:56:01.313ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e7b5f369-1b5a-435d-98af-daef3797ba49", "date": "Mon, 13 Jan 2025 22:56:01 GMT"} })
112172025-01-13T22:56:01.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112182025-01-13T22:56:01.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112192025-01-13T22:56:01.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112202025-01-13T22:56:01.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112212025-01-13T22:56:01.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112222025-01-13T22:56:01.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112232025-01-13T22:56:01.322ZINFOnexus (BackgroundTasks): VPC route manager sled bd8d50a3-f530-430e-8ded-11b6657cae3b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112242025-01-13T22:56:01.322ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112252025-01-13T22:56:01.322ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d0cf20d8-c3d8-4a2a-b46e-c6508d6edb27", "date": "Mon, 13 Jan 2025 22:56:01 GMT"} })
112262025-01-13T22:56:01.324ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 228.748013ms iteration = 27 status = {}
112272025-01-13T22:56:01.334ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112282025-01-13T22:56:01.335ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "87f2ff5b-6f80-4088-a80c-7bf8bd26084d", "content-length": "2", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112292025-01-13T22:56:01.336ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112302025-01-13T22:56:01.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112312025-01-13T22:56:01.338ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.095246ms iteration = 26 status = null
112322025-01-13T22:56:01.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112332025-01-13T22:56:01.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112342025-01-13T22:56:01.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112352025-01-13T22:56:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112362025-01-13T22:56:01.404ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 654c0df1-6cc5-45ba-99ca-990c3ca5b382, rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9e2e061d-101e-474d-9526-cd14b805d146) } rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
112372025-01-13T22:56:01.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112382025-01-13T22:56:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112392025-01-13T22:56:01.413ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112402025-01-13T22:56:01.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4443edfd-c284-431e-b815-9675b9256759", "content-length": "134", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112412025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112422025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9e2e061d-101e-474d-9526-cd14b805d146
112432025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112442025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112452025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112462025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112472025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112482025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112492025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112502025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112512025-01-13T22:56:01.414ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6
112522025-01-13T22:56:01.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112532025-01-13T22:56:01.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112542025-01-13T22:56:01.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112552025-01-13T22:56:01.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaf4e115-1bcc-42e3-bf1b-193320bc2822", "content-length": "2", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112562025-01-13T22:56:01.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112572025-01-13T22:56:01.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9da590ae-bd93-4ad3-a631-a4432978db05", "content-length": "51", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112582025-01-13T22:56:01.417ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch_location = Switch0
112592025-01-13T22:56:01.417ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112602025-01-13T22:56:01.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112612025-01-13T22:56:01.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112622025-01-13T22:56:01.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112632025-01-13T22:56:01.455ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112642025-01-13T22:56:01.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112652025-01-13T22:56:01.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112662025-01-13T22:56:01.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112672025-01-13T22:56:01.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112682025-01-13T22:56:01.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112692025-01-13T22:56:01.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112702025-01-13T22:56:01.513ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4bc85f70-0f45-4f7e-ba1e-6e8f66d77813", "date": "Mon, 13 Jan 2025 22:56:01 GMT"} })
112712025-01-13T22:56:01.513ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 switch = Switch0
112722025-01-13T22:56:01.513ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112732025-01-13T22:56:01.514ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 646472ad-69b3-4142-8cd4-bbfc619624e6 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dfe264f-11a5-490c-9dfb-d7c8f9a310fe", "content-length": "682", "date": "Mon, 13 Jan 2025 22:56:01 GMT"} })
112742025-01-13T22:56:01.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112752025-01-13T22:56:01.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112762025-01-13T22:56:01.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112772025-01-13T22:56:01.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112782025-01-13T22:56:01.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112792025-01-13T22:56:01.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112802025-01-13T22:56:01.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112812025-01-13T22:56:01.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112822025-01-13T22:56:01.530ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 463.876067ms iteration = 26 status = {}
112832025-01-13T22:56:01.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b3b3ebb2-4009-4bc7-8240-373d83ed0c4d roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
112842025-01-13T22:56:01.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b3b3ebb2-4009-4bc7-8240-373d83ed0c4d resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
112852025-01-13T22:56:01.572ZDEBGnexus (BackgroundTasks): client request SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112862025-01-13T22:56:01.573ZDEBGnexus (BackgroundTasks): client response SledAgent = bd8d50a3-f530-430e-8ded-11b6657cae3b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "11936af0-9709-478e-a52b-1f8009801250", "content-length": "691", "date": "Mon, 13 Jan 2025 22:56:00 GMT"} })
112872025-01-13T22:56:01.573ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
112882025-01-13T22:56:01.573ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
112892025-01-13T22:56:01.573ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
112902025-01-13T22:56:01.573ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 335.901053ms iteration = 27 status = {}
112912025-01-13T22:56:01.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = b3b3ebb2-4009-4bc7-8240-373d83ed0c4d response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
112922025-01-13T22:56:01.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = fba9ecc5-95d9-4995-9621-8410600937f4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
112932025-01-13T22:56:01.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = fba9ecc5-95d9-4995-9621-8410600937f4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
112942025-01-13T22:56:01.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42441 req_id = fba9ecc5-95d9-4995-9621-8410600937f4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
112952025-01-13T22:56:02.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 308d5337-7204-4a83-ae79-7cfd34612f97 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
112962025-01-13T22:56:02.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 308d5337-7204-4a83-ae79-7cfd34612f97 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
112972025-01-13T22:56:02.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 308d5337-7204-4a83-ae79-7cfd34612f97 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
112982025-01-13T22:56:03.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 636 local_addr = [fd00:1122:3344:101::b]:56371 method = GET remote_addr = [fd00:1122:3344:101::d]:61125 req_id = ec2bef39-ab37-4dbc-aef5-bb5d71486090 response_code = 200 uri = /e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
112992025-01-13T22:56:03.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5a7d5215-60fb-4f12-94d2-b4f908c2f1fc roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113002025-01-13T22:56:03.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5a7d5215-60fb-4f12-94d2-b4f908c2f1fc resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113012025-01-13T22:56:03.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 5a7d5215-60fb-4f12-94d2-b4f908c2f1fc response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113022025-01-13T22:56:04.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 40a71aaf-0261-4460-b01b-96b8b7930e85 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113032025-01-13T22:56:04.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 40a71aaf-0261-4460-b01b-96b8b7930e85 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113042025-01-13T22:56:04.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 40a71aaf-0261-4460-b01b-96b8b7930e85 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113052025-01-13T22:56:05.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f71e107c-0f26-46e1-aa35-ccefeb535b28 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113062025-01-13T22:56:05.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f71e107c-0f26-46e1-aa35-ccefeb535b28 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113072025-01-13T22:56:05.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = f71e107c-0f26-46e1-aa35-ccefeb535b28 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113082025-01-13T22:56:06.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6691d8a2-177b-4bc4-9c4a-c4f11a6b572b roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113092025-01-13T22:56:06.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6691d8a2-177b-4bc4-9c4a-c4f11a6b572b resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113102025-01-13T22:56:06.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 6691d8a2-177b-4bc4-9c4a-c4f11a6b572b response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113112025-01-13T22:56:07.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69473171-b3af-43e9-99b7-697154a524d0 roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113122025-01-13T22:56:07.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69473171-b3af-43e9-99b7-697154a524d0 resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113132025-01-13T22:56:07.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 69473171-b3af-43e9-99b7-697154a524d0 response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113142025-01-13T22:56:08.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 689f9dd2-9828-454d-8373-6916b76e1c9e roles = RoleSet { roles: {} } uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113152025-01-13T22:56:08.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 689f9dd2-9828-454d-8373-6916b76e1c9e resource = Database result = Ok(()) uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b
113162025-01-13T22:56:08.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:48575 req_id = 689f9dd2-9828-454d-8373-6916b76e1c9e response_code = 200 uri = /probes/bd8d50a3-f530-430e-8ded-11b6657cae3b