Max level shown:
12025-02-23T09:15:02.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 180bec12-c112-4f99-a6db-ea7facdbb8a0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22025-02-23T09:15:02.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 180bec12-c112-4f99-a6db-ea7facdbb8a0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32025-02-23T09:15:02.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 180bec12-c112-4f99-a6db-ea7facdbb8a0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
42025-02-23T09:15:03.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 08f61e89-3e3c-40dc-8d72-947b7fc845ae roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
52025-02-23T09:15:03.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 08f61e89-3e3c-40dc-8d72-947b7fc845ae resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
62025-02-23T09:15:03.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 08f61e89-3e3c-40dc-8d72-947b7fc845ae response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72025-02-23T09:15:04.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0d391c90-f01f-44ae-a14c-f4b90a38b9a4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
82025-02-23T09:15:04.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0d391c90-f01f-44ae-a14c-f4b90a38b9a4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
92025-02-23T09:15:04.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0d391c90-f01f-44ae-a14c-f4b90a38b9a4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
102025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
112025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
122025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
132025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
152025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
162025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
172025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
182025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
192025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
202025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
212025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
222025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
232025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
242025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
252025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
262025-02-23T09:15:04.526ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
272025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
282025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
292025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
302025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
312025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
322025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
332025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
342025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
352025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
362025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
372025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
382025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
392025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
402025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
412025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
422025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
432025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
442025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
452025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
462025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
472025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
482025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
492025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
502025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
512025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
522025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
532025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
542025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
552025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
562025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
572025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
582025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
592025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
602025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
612025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
622025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
632025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
642025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
652025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
662025-02-23T09:15:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
672025-02-23T09:15:04.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
682025-02-23T09:15:04.529ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35920, tv_nsec: 231115273 } })
692025-02-23T09:15:04.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
702025-02-23T09:15:04.530ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
712025-02-23T09:15:04.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
722025-02-23T09:15:04.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
732025-02-23T09:15:04.531ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.861731ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
742025-02-23T09:15:04.531ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
752025-02-23T09:15:04.531ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
762025-02-23T09:15:04.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
772025-02-23T09:15:04.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
782025-02-23T09:15:04.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
792025-02-23T09:15:04.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
802025-02-23T09:15:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
812025-02-23T09:15:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
822025-02-23T09:15:04.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
832025-02-23T09:15:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
842025-02-23T09:15:04.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852025-02-23T09:15:04.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
862025-02-23T09:15:04.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
872025-02-23T09:15:04.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
882025-02-23T09:15:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
892025-02-23T09:15:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
902025-02-23T09:15:04.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
912025-02-23T09:15:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
922025-02-23T09:15:04.542ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
932025-02-23T09:15:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
942025-02-23T09:15:04.545ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
952025-02-23T09:15:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
962025-02-23T09:15:04.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
972025-02-23T09:15:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
982025-02-23T09:15:04.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35920, tv_nsec: 247773765 } })
992025-02-23T09:15:04.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
1002025-02-23T09:15:04.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1012025-02-23T09:15:04.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 27.378102ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
1022025-02-23T09:15:04.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1032025-02-23T09:15:04.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1042025-02-23T09:15:04.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1052025-02-23T09:15:04.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1062025-02-23T09:15:04.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1072025-02-23T09:15:04.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1082025-02-23T09:15:04.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1092025-02-23T09:15:04.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1102025-02-23T09:15:04.565ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1112025-02-23T09:15:04.565ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1122025-02-23T09:15:04.565ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1132025-02-23T09:15:04.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.408778ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1142025-02-23T09:15:04.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1152025-02-23T09:15:04.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1162025-02-23T09:15:04.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1172025-02-23T09:15:04.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1182025-02-23T09:15:04.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1192025-02-23T09:15:04.566ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35920, tv_nsec: 268233688 } })
1202025-02-23T09:15:04.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1212025-02-23T09:15:04.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
1222025-02-23T09:15:04.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1232025-02-23T09:15:04.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1242025-02-23T09:15:04.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1252025-02-23T09:15:04.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1262025-02-23T09:15:04.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1272025-02-23T09:15:04.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1282025-02-23T09:15:04.571ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1292025-02-23T09:15:04.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1302025-02-23T09:15:04.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1312025-02-23T09:15:04.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1322025-02-23T09:15:04.573ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1332025-02-23T09:15:04.573ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1342025-02-23T09:15:04.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 47.731993ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1352025-02-23T09:15:04.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1362025-02-23T09:15:04.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1372025-02-23T09:15:04.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1382025-02-23T09:15:04.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1392025-02-23T09:15:04.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1402025-02-23T09:15:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1412025-02-23T09:15:04.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.376608ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
1422025-02-23T09:15:04.619ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1432025-02-23T09:15:04.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.541761ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1442025-02-23T09:15:04.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.456148ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1452025-02-23T09:15:04.624ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1462025-02-23T09:15:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1472025-02-23T09:15:04.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1482025-02-23T09:15:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1492025-02-23T09:15:04.628ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1502025-02-23T09:15:04.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.329195ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
1512025-02-23T09:15:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1522025-02-23T09:15:04.629ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 103.090589ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
1532025-02-23T09:15:04.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
1542025-02-23T09:15:04.629ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1552025-02-23T09:15:04.630ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f017612-1eca-4119-9a98-85a1ad5fd87f", "content-length": "26", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
1562025-02-23T09:15:04.630ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1572025-02-23T09:15:04.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1582025-02-23T09:15:04.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592025-02-23T09:15:04.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
1602025-02-23T09:15:04.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1612025-02-23T09:15:04.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1622025-02-23T09:15:04.649ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
1632025-02-23T09:15:04.649ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1642025-02-23T09:15:04.649ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c87c31a1-7266-44aa-90cc-fc81e1e1a4e0", "content-length": "26", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
1652025-02-23T09:15:04.649ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1662025-02-23T09:15:04.651ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1672025-02-23T09:15:04.689ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1682025-02-23T09:15:04.689ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1692025-02-23T09:15:04.690ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "432f0364-4924-4fd5-9092-51a13cb2b3aa", "content-length": "372", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
1702025-02-23T09:15:04.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1712025-02-23T09:15:04.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1722025-02-23T09:15:04.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732025-02-23T09:15:04.693ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1742025-02-23T09:15:04.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.966513ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1752025-02-23T09:15:04.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1762025-02-23T09:15:04.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1772025-02-23T09:15:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1782025-02-23T09:15:04.696ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1792025-02-23T09:15:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1802025-02-23T09:15:04.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812025-02-23T09:15:04.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1822025-02-23T09:15:04.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1832025-02-23T09:15:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1842025-02-23T09:15:04.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1852025-02-23T09:15:04.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
1862025-02-23T09:15:04.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1872025-02-23T09:15:04.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1882025-02-23T09:15:04.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1892025-02-23T09:15:04.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1902025-02-23T09:15:04.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1912025-02-23T09:15:04.702ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 175.748898ms iteration = 14 status = 0
1922025-02-23T09:15:04.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
1932025-02-23T09:15:04.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 181.290842ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
1942025-02-23T09:15:04.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
1952025-02-23T09:15:04.711ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1962025-02-23T09:15:04.712ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4597b1e-7d71-4e0a-9d66-7294bb511786", "content-length": "26", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
1972025-02-23T09:15:04.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1982025-02-23T09:15:04.714ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
1992025-02-23T09:15:04.737ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
2002025-02-23T09:15:04.737ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 211.133991ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2012025-02-23T09:15:04.740ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2022025-02-23T09:15:04.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2032025-02-23T09:15:04.740ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5487e08b-2ef8-4979-bfe0-d120d7c0e62b", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2042025-02-23T09:15:04.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2052025-02-23T09:15:04.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2062025-02-23T09:15:04.742ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2072025-02-23T09:15:04.742ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b11ecfc-7692-4d3d-93e3-0325b5aad4a4", "content-length": "2", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2082025-02-23T09:15:04.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2092025-02-23T09:15:04.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2102025-02-23T09:15:04.745ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2112025-02-23T09:15:04.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2122025-02-23T09:15:04.747ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 221.478034ms iteration = 14 status = null
2132025-02-23T09:15:04.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2142025-02-23T09:15:04.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2152025-02-23T09:15:04.789ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 262.91297ms iteration = 14 status = {}
2162025-02-23T09:15:04.799ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2172025-02-23T09:15:04.799ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "98914247-13dc-4cdb-8cde-2d423247039e", "content-length": "691", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2182025-02-23T09:15:04.799ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2192025-02-23T09:15:04.799ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2202025-02-23T09:15:04.799ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2212025-02-23T09:15:04.800ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 274.579347ms iteration = 14 status = {}
2222025-02-23T09:15:04.803ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2232025-02-23T09:15:04.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2242025-02-23T09:15:04.803ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 277.542163ms iteration = 16 status = {"physical_disks_added":0}
2252025-02-23T09:15:04.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6dcc7b5e-ccea-4c83-ae9f-d82be7101864", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2262025-02-23T09:15:04.805ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.652473ms iteration = 14 status = {}
2272025-02-23T09:15:04.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2282025-02-23T09:15:04.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2292025-02-23T09:15:04.864ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
2302025-02-23T09:15:04.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2312025-02-23T09:15:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2322025-02-23T09:15:04.875ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2332025-02-23T09:15:04.875ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5deb68fd-69c6-4017-a862-f67cc9d48456", "content-length": "134", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2342025-02-23T09:15:04.875ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2352025-02-23T09:15:04.875ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
2362025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2372025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2382025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2392025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2402025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2412025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2422025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2432025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2442025-02-23T09:15:04.876ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
2452025-02-23T09:15:04.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2462025-02-23T09:15:04.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472025-02-23T09:15:04.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2482025-02-23T09:15:04.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec0bd12d-0f92-4e3a-b75e-9cf1cdd4a20f", "content-length": "2", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2492025-02-23T09:15:04.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2502025-02-23T09:15:04.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "21bcabf0-fc2a-4254-bc64-ec09edd40caa", "content-length": "52", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2512025-02-23T09:15:04.878ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
2522025-02-23T09:15:04.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2532025-02-23T09:15:05.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b806bffe-d930-47dc-abf1-b741499314fb", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2542025-02-23T09:15:05.028ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
2552025-02-23T09:15:05.028ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2562025-02-23T09:15:05.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e092223b-3190-49fe-953c-5e6b5296a5d0", "content-length": "682", "date": "Sun, 23 Feb 2025 09:15:04 GMT"} })
2572025-02-23T09:15:05.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2582025-02-23T09:15:05.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592025-02-23T09:15:05.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2602025-02-23T09:15:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2612025-02-23T09:15:05.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2622025-02-23T09:15:05.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2632025-02-23T09:15:05.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2642025-02-23T09:15:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2652025-02-23T09:15:05.051ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.210088ms iteration = 14 status = {}
2662025-02-23T09:15:05.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d1e6b25-1ab6-45d7-9304-8f432d6a8afa roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2672025-02-23T09:15:05.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d1e6b25-1ab6-45d7-9304-8f432d6a8afa resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2682025-02-23T09:15:05.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d1e6b25-1ab6-45d7-9304-8f432d6a8afa response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2692025-02-23T09:15:06.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 6ec02bfe-3a5c-430b-bfaa-0e40c2b72e51 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
2702025-02-23T09:15:06.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 6ec02bfe-3a5c-430b-bfaa-0e40c2b72e51 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
2712025-02-23T09:15:06.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 6ec02bfe-3a5c-430b-bfaa-0e40c2b72e51 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
2722025-02-23T09:15:06.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a4d495af-5a2a-4352-8f0c-182c0ab1e5c9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2732025-02-23T09:15:06.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a4d495af-5a2a-4352-8f0c-182c0ab1e5c9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2742025-02-23T09:15:06.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a4d495af-5a2a-4352-8f0c-182c0ab1e5c9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2752025-02-23T09:15:07.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 8d8a8419-e0e8-4d88-a38b-7b13523320ee response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
2762025-02-23T09:15:07.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2a8e956f-5189-4d0c-9071-ae30fe97c1a6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2772025-02-23T09:15:07.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2a8e956f-5189-4d0c-9071-ae30fe97c1a6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2782025-02-23T09:15:07.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2a8e956f-5189-4d0c-9071-ae30fe97c1a6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2792025-02-23T09:15:08.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b4f7c05e-7759-41ca-ae53-dd460686f060 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2802025-02-23T09:15:08.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b4f7c05e-7759-41ca-ae53-dd460686f060 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2812025-02-23T09:15:08.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b4f7c05e-7759-41ca-ae53-dd460686f060 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2822025-02-23T09:15:09.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 93aaa3b4-9ae7-40b0-973e-c0324c1ca01d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2832025-02-23T09:15:09.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 93aaa3b4-9ae7-40b0-973e-c0324c1ca01d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2842025-02-23T09:15:09.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 93aaa3b4-9ae7-40b0-973e-c0324c1ca01d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2852025-02-23T09:15:10.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 55f0a5bb-e3e4-4e84-b7b5-b6fc03fef0fe roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2862025-02-23T09:15:10.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 55f0a5bb-e3e4-4e84-b7b5-b6fc03fef0fe resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2872025-02-23T09:15:10.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 55f0a5bb-e3e4-4e84-b7b5-b6fc03fef0fe response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2882025-02-23T09:15:11.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5cc345bd-f9bf-4925-820e-8755081b713a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2892025-02-23T09:15:11.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5cc345bd-f9bf-4925-820e-8755081b713a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2902025-02-23T09:15:11.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5cc345bd-f9bf-4925-820e-8755081b713a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2912025-02-23T09:15:12.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 89a92fe3-f7bf-47ae-b3d0-da3bde10eac8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2922025-02-23T09:15:12.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 89a92fe3-f7bf-47ae-b3d0-da3bde10eac8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2932025-02-23T09:15:12.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 89a92fe3-f7bf-47ae-b3d0-da3bde10eac8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2942025-02-23T09:15:13.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ef29e495-e2b9-43f4-8f1e-e93de50c7696 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2952025-02-23T09:15:13.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ef29e495-e2b9-43f4-8f1e-e93de50c7696 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2962025-02-23T09:15:13.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ef29e495-e2b9-43f4-8f1e-e93de50c7696 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2972025-02-23T09:15:14.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0843c677-9301-486d-aa6f-e0571495487d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2982025-02-23T09:15:14.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0843c677-9301-486d-aa6f-e0571495487d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2992025-02-23T09:15:14.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0843c677-9301-486d-aa6f-e0571495487d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3002025-02-23T09:15:14.525ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
3012025-02-23T09:15:14.525ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
3022025-02-23T09:15:14.525ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3032025-02-23T09:15:14.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3042025-02-23T09:15:14.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3052025-02-23T09:15:14.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3062025-02-23T09:15:14.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3072025-02-23T09:15:14.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082025-02-23T09:15:14.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3092025-02-23T09:15:14.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3102025-02-23T09:15:14.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3112025-02-23T09:15:14.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3122025-02-23T09:15:14.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3132025-02-23T09:15:14.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3142025-02-23T09:15:14.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3152025-02-23T09:15:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
3162025-02-23T09:15:14.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3172025-02-23T09:15:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3182025-02-23T09:15:14.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
3192025-02-23T09:15:14.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.084069ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
3202025-02-23T09:15:14.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.901618ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3212025-02-23T09:15:15.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 14a53600-75b8-4531-b92a-593c5ece5f21 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3222025-02-23T09:15:15.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 14a53600-75b8-4531-b92a-593c5ece5f21 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3232025-02-23T09:15:15.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 14a53600-75b8-4531-b92a-593c5ece5f21 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3242025-02-23T09:15:16.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b56c1b0-ef61-4079-bef5-0f303b4d749f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3252025-02-23T09:15:16.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b56c1b0-ef61-4079-bef5-0f303b4d749f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3262025-02-23T09:15:16.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b56c1b0-ef61-4079-bef5-0f303b4d749f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3272025-02-23T09:15:17.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 678 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 9de78e23-729f-404b-b74e-2942b4b46b03 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
3282025-02-23T09:15:17.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 207b8a0c-cb5f-421b-a5f3-76426ef97172 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3292025-02-23T09:15:17.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 207b8a0c-cb5f-421b-a5f3-76426ef97172 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3302025-02-23T09:15:17.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 207b8a0c-cb5f-421b-a5f3-76426ef97172 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3312025-02-23T09:15:18.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6c06efdc-dbdd-4d8f-a53c-fefe73e70b4d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3322025-02-23T09:15:18.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6c06efdc-dbdd-4d8f-a53c-fefe73e70b4d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3332025-02-23T09:15:18.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6c06efdc-dbdd-4d8f-a53c-fefe73e70b4d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3342025-02-23T09:15:19.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f699b249-b66b-4d7f-a408-773660d8b039 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3352025-02-23T09:15:19.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f699b249-b66b-4d7f-a408-773660d8b039 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3362025-02-23T09:15:19.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f699b249-b66b-4d7f-a408-773660d8b039 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3372025-02-23T09:15:20.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8fb73278-4d7e-4a73-87ed-ee088f9c2f13 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3382025-02-23T09:15:20.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8fb73278-4d7e-4a73-87ed-ee088f9c2f13 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3392025-02-23T09:15:20.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8fb73278-4d7e-4a73-87ed-ee088f9c2f13 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3402025-02-23T09:15:21.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 49a00182-2ce3-4978-bd6b-259a7d5f2f2b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3412025-02-23T09:15:21.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 49a00182-2ce3-4978-bd6b-259a7d5f2f2b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3422025-02-23T09:15:21.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 49a00182-2ce3-4978-bd6b-259a7d5f2f2b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3432025-02-23T09:15:22.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8ae505e8-54ed-470d-9012-760030867337 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3442025-02-23T09:15:22.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8ae505e8-54ed-470d-9012-760030867337 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3452025-02-23T09:15:22.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8ae505e8-54ed-470d-9012-760030867337 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3462025-02-23T09:15:23.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c544a809-dfed-46fb-9314-3a271f9288a9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3472025-02-23T09:15:23.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c544a809-dfed-46fb-9314-3a271f9288a9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3482025-02-23T09:15:23.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c544a809-dfed-46fb-9314-3a271f9288a9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3492025-02-23T09:15:24.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
3502025-02-23T09:15:24.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
3512025-02-23T09:15:24.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3522025-02-23T09:15:24.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3532025-02-23T09:15:24.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3542025-02-23T09:15:24.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3552025-02-23T09:15:24.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3562025-02-23T09:15:24.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3572025-02-23T09:15:24.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3582025-02-23T09:15:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3592025-02-23T09:15:24.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3602025-02-23T09:15:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3612025-02-23T09:15:24.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.164717ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3622025-02-23T09:15:24.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3632025-02-23T09:15:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3642025-02-23T09:15:24.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3652025-02-23T09:15:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
3662025-02-23T09:15:24.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3672025-02-23T09:15:24.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3682025-02-23T09:15:24.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
3692025-02-23T09:15:24.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.606304ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
3702025-02-23T09:15:24.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b546b079-9dba-4e4c-b9cd-74c9b45e5e27 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3712025-02-23T09:15:24.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b546b079-9dba-4e4c-b9cd-74c9b45e5e27 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3722025-02-23T09:15:24.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b546b079-9dba-4e4c-b9cd-74c9b45e5e27 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3732025-02-23T09:15:25.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b36e159-8507-4699-9003-31a5ffa4e93e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3742025-02-23T09:15:25.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b36e159-8507-4699-9003-31a5ffa4e93e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3752025-02-23T09:15:25.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b36e159-8507-4699-9003-31a5ffa4e93e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3762025-02-23T09:15:26.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b15f888d-e0d3-4628-9f2e-efab57981c60 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3772025-02-23T09:15:26.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b15f888d-e0d3-4628-9f2e-efab57981c60 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3782025-02-23T09:15:26.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b15f888d-e0d3-4628-9f2e-efab57981c60 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3792025-02-23T09:15:27.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 609 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 4654d768-aa12-4f71-9912-d70dde846f67 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
3802025-02-23T09:15:27.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 371cb726-5c9a-4dcf-866a-efe96cf50ffa roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3812025-02-23T09:15:27.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 371cb726-5c9a-4dcf-866a-efe96cf50ffa resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3822025-02-23T09:15:27.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 371cb726-5c9a-4dcf-866a-efe96cf50ffa response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3832025-02-23T09:15:28.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a50fdc75-32c1-4645-8232-e863f9e89a5a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3842025-02-23T09:15:28.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a50fdc75-32c1-4645-8232-e863f9e89a5a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3852025-02-23T09:15:28.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a50fdc75-32c1-4645-8232-e863f9e89a5a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3862025-02-23T09:15:29.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b05349f-b1d9-45e0-ac22-9552e103c476 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3872025-02-23T09:15:29.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b05349f-b1d9-45e0-ac22-9552e103c476 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3882025-02-23T09:15:29.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b05349f-b1d9-45e0-ac22-9552e103c476 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3892025-02-23T09:15:30.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fb492f6e-d9a9-4e33-a513-694cc26a7c6a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3902025-02-23T09:15:30.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fb492f6e-d9a9-4e33-a513-694cc26a7c6a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3912025-02-23T09:15:30.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fb492f6e-d9a9-4e33-a513-694cc26a7c6a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3922025-02-23T09:15:31.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9596b3be-6f99-407b-83f5-00ecdf71707f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3932025-02-23T09:15:31.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9596b3be-6f99-407b-83f5-00ecdf71707f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3942025-02-23T09:15:31.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9596b3be-6f99-407b-83f5-00ecdf71707f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3952025-02-23T09:15:32.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = fb92b732-6466-40fd-99b3-572f0c2801ca roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
3962025-02-23T09:15:32.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = fb92b732-6466-40fd-99b3-572f0c2801ca resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
3972025-02-23T09:15:32.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = fb92b732-6466-40fd-99b3-572f0c2801ca response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
3982025-02-23T09:15:32.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 32e00ef6-0e6b-4e83-8246-d1232e9debbb roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
3992025-02-23T09:15:32.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 32e00ef6-0e6b-4e83-8246-d1232e9debbb resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
4002025-02-23T09:15:32.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 32e00ef6-0e6b-4e83-8246-d1232e9debbb response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
4012025-02-23T09:15:32.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a805089a-0337-4a07-9045-737e0af38784 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4022025-02-23T09:15:32.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a805089a-0337-4a07-9045-737e0af38784 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4032025-02-23T09:15:32.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a805089a-0337-4a07-9045-737e0af38784 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4042025-02-23T09:15:33.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9908a393-19b8-4fff-a392-df5f86e2c301 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4052025-02-23T09:15:33.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9908a393-19b8-4fff-a392-df5f86e2c301 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4062025-02-23T09:15:33.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9908a393-19b8-4fff-a392-df5f86e2c301 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4072025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
4082025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
4092025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4102025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4112025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4122025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
4132025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4142025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
4152025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
4162025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
4172025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4182025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
4192025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
4202025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4212025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4222025-02-23T09:15:34.525ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:05:34.525758606 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4232025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4242025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4252025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
4262025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
4272025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4282025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4292025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
4302025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4312025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4322025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
4332025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4342025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4352025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4362025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
4372025-02-23T09:15:34.525ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
4382025-02-23T09:15:34.526ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4392025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4402025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4412025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
4422025-02-23T09:15:34.526ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4432025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4442025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
4452025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4462025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
4472025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4482025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
4492025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4502025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4512025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
4522025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4532025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
4542025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
4552025-02-23T09:15:34.526ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
4562025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
4572025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4582025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.71\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
4592025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4602025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4612025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4622025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4632025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4642025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4652025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4662025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4672025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4682025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4692025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4702025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4712025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
4722025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4732025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
4742025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4752025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4762025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4772025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
4782025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
4792025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4802025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4812025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
4822025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4832025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
4842025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
4852025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
4862025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4872025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4882025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4892025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4902025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4912025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4922025-02-23T09:15:34.526ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 35950, tv_nsec: 227706201 } })
4932025-02-23T09:15:34.526ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 35950, tv_nsec: 227744262 } })
4942025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4952025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4962025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4972025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
4982025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4992025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5002025-02-23T09:15:34.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5012025-02-23T09:15:34.527ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5022025-02-23T09:15:34.527ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.127911ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5032025-02-23T09:15:34.527ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
5042025-02-23T09:15:34.527ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.761513ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5052025-02-23T09:15:34.528ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5062025-02-23T09:15:34.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5072025-02-23T09:15:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.832981ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5082025-02-23T09:15:34.530ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35950, tv_nsec: 231747067 } })
5092025-02-23T09:15:34.531ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
5102025-02-23T09:15:34.531ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:05:34.525758606 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5112025-02-23T09:15:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5122025-02-23T09:15:34.531ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5132025-02-23T09:15:34.531ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.081094ms iteration = 8 status = {"expiration":"2025-02-23T09:05:34.525758606Z","pruned":[]}
5142025-02-23T09:15:34.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5152025-02-23T09:15:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5162025-02-23T09:15:34.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5172025-02-23T09:15:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5182025-02-23T09:15:34.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192025-02-23T09:15:34.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35950, tv_nsec: 238320660 } })
5202025-02-23T09:15:34.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
5212025-02-23T09:15:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5222025-02-23T09:15:34.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5232025-02-23T09:15:34.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5242025-02-23T09:15:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5252025-02-23T09:15:34.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5262025-02-23T09:15:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5272025-02-23T09:15:34.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282025-02-23T09:15:34.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5292025-02-23T09:15:34.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5302025-02-23T09:15:34.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5312025-02-23T09:15:34.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5322025-02-23T09:15:34.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5332025-02-23T09:15:34.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5342025-02-23T09:15:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5352025-02-23T09:15:34.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5362025-02-23T09:15:34.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5372025-02-23T09:15:34.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5382025-02-23T09:15:34.549ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5392025-02-23T09:15:34.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5402025-02-23T09:15:34.549ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5412025-02-23T09:15:34.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5422025-02-23T09:15:34.554ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 28.046425ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
5432025-02-23T09:15:34.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5442025-02-23T09:15:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5452025-02-23T09:15:34.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5462025-02-23T09:15:34.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5472025-02-23T09:15:34.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.367053ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
5482025-02-23T09:15:34.584ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5492025-02-23T09:15:34.584ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.430033ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5502025-02-23T09:15:34.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5512025-02-23T09:15:34.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5522025-02-23T09:15:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5532025-02-23T09:15:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5542025-02-23T09:15:34.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35950, tv_nsec: 287407078 } })
5552025-02-23T09:15:34.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
5562025-02-23T09:15:34.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5572025-02-23T09:15:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5582025-02-23T09:15:34.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592025-02-23T09:15:34.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5602025-02-23T09:15:34.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5612025-02-23T09:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
5622025-02-23T09:15:34.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5632025-02-23T09:15:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5642025-02-23T09:15:34.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652025-02-23T09:15:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5662025-02-23T09:15:34.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5672025-02-23T09:15:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5682025-02-23T09:15:34.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692025-02-23T09:15:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5702025-02-23T09:15:34.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5712025-02-23T09:15:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5722025-02-23T09:15:34.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5732025-02-23T09:15:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5742025-02-23T09:15:34.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5752025-02-23T09:15:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5762025-02-23T09:15:34.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772025-02-23T09:15:34.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5782025-02-23T09:15:34.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5792025-02-23T09:15:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5802025-02-23T09:15:34.649ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5812025-02-23T09:15:34.649ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5822025-02-23T09:15:34.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5832025-02-23T09:15:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5842025-02-23T09:15:34.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5852025-02-23T09:15:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5862025-02-23T09:15:34.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872025-02-23T09:15:34.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5882025-02-23T09:15:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5892025-02-23T09:15:34.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5902025-02-23T09:15:34.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5912025-02-23T09:15:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5922025-02-23T09:15:34.658ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5932025-02-23T09:15:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5942025-02-23T09:15:34.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.836834ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5952025-02-23T09:15:34.663ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5962025-02-23T09:15:34.663ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5972025-02-23T09:15:34.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5982025-02-23T09:15:34.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5992025-02-23T09:15:34.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 137.510913ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
6002025-02-23T09:15:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6012025-02-23T09:15:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6022025-02-23T09:15:34.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6032025-02-23T09:15:34.666ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6042025-02-23T09:15:34.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6052025-02-23T09:15:34.667ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6062025-02-23T09:15:34.667ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6072025-02-23T09:15:34.667ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 141.351015ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6082025-02-23T09:15:34.669ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6092025-02-23T09:15:34.669ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6102025-02-23T09:15:34.669ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 142.955655ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6112025-02-23T09:15:34.670ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
6122025-02-23T09:15:34.670ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 144.570655ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
6132025-02-23T09:15:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6142025-02-23T09:15:34.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6152025-02-23T09:15:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6162025-02-23T09:15:34.673ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6172025-02-23T09:15:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6182025-02-23T09:15:34.678ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6192025-02-23T09:15:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6202025-02-23T09:15:34.681ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
6212025-02-23T09:15:34.681ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 155.419519ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
6222025-02-23T09:15:34.685ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 158.740621ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
6232025-02-23T09:15:34.687ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6242025-02-23T09:15:34.687ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6252025-02-23T09:15:34.687ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6262025-02-23T09:15:34.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6272025-02-23T09:15:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6282025-02-23T09:15:34.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292025-02-23T09:15:34.690ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6302025-02-23T09:15:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6312025-02-23T09:15:34.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6322025-02-23T09:15:34.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6332025-02-23T09:15:34.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6342025-02-23T09:15:34.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6352025-02-23T09:15:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6362025-02-23T09:15:34.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6372025-02-23T09:15:34.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6382025-02-23T09:15:34.721ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
6392025-02-23T09:15:34.721ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6402025-02-23T09:15:34.721ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cbca087-58d7-447c-a3b9-66cda50d6ad7", "content-length": "26", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
6412025-02-23T09:15:34.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6422025-02-23T09:15:34.726ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6432025-02-23T09:15:34.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442025-02-23T09:15:34.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6452025-02-23T09:15:34.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6462025-02-23T09:15:34.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6472025-02-23T09:15:34.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6482025-02-23T09:15:34.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6492025-02-23T09:15:34.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502025-02-23T09:15:34.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6512025-02-23T09:15:34.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6522025-02-23T09:15:34.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
6532025-02-23T09:15:34.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6542025-02-23T09:15:34.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6552025-02-23T09:15:34.737ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6562025-02-23T09:15:34.737ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6572025-02-23T09:15:34.737ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6582025-02-23T09:15:34.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6592025-02-23T09:15:34.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6602025-02-23T09:15:34.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6612025-02-23T09:15:34.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 212.273482ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6622025-02-23T09:15:34.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 212.449576ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6632025-02-23T09:15:34.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 216.013582ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6642025-02-23T09:15:34.742ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) }
6652025-02-23T09:15:34.742ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 216.561423ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
6662025-02-23T09:15:34.744ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6672025-02-23T09:15:34.744ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6682025-02-23T09:15:34.744ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 218.321286ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6692025-02-23T09:15:34.744ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 219.088029ms iteration = 15 status = 0
6702025-02-23T09:15:34.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6712025-02-23T09:15:34.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6722025-02-23T09:15:34.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6732025-02-23T09:15:34.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6742025-02-23T09:15:34.752ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6752025-02-23T09:15:34.752ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6762025-02-23T09:15:34.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6772025-02-23T09:15:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6782025-02-23T09:15:34.754ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6792025-02-23T09:15:34.754ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
6802025-02-23T09:15:34.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6812025-02-23T09:15:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6822025-02-23T09:15:34.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
6832025-02-23T09:15:34.755ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6842025-02-23T09:15:34.755ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f9378a2-1655-4f1e-8d37-fbc6dda1da12", "content-length": "26", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
6852025-02-23T09:15:34.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6862025-02-23T09:15:34.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872025-02-23T09:15:34.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882025-02-23T09:15:34.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6892025-02-23T09:15:34.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6902025-02-23T09:15:34.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6912025-02-23T09:15:34.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6922025-02-23T09:15:34.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6932025-02-23T09:15:34.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6942025-02-23T09:15:34.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6952025-02-23T09:15:34.768ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
6962025-02-23T09:15:34.768ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
6972025-02-23T09:15:34.768ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
6982025-02-23T09:15:34.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 242.867424ms iteration = 8 status = {"generation":2}
6992025-02-23T09:15:34.773ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7002025-02-23T09:15:34.773ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7012025-02-23T09:15:34.773ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
7022025-02-23T09:15:34.773ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 246.197447ms iteration = 8 status = {"generation":1}
7032025-02-23T09:15:34.786ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
7042025-02-23T09:15:34.786ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7052025-02-23T09:15:34.787ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "629ca18e-6d97-4260-8d7d-a7790ba86fbc", "content-length": "26", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
7062025-02-23T09:15:34.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7072025-02-23T09:15:34.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
7082025-02-23T09:15:34.795ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7092025-02-23T09:15:34.822ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 296.899156ms iteration = 17 status = {"physical_disks_added":0}
7102025-02-23T09:15:34.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7112025-02-23T09:15:34.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7122025-02-23T09:15:34.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132025-02-23T09:15:34.837ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7142025-02-23T09:15:34.837ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 312.191552ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7152025-02-23T09:15:34.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7162025-02-23T09:15:34.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7172025-02-23T09:15:34.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7182025-02-23T09:15:34.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192025-02-23T09:15:34.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7202025-02-23T09:15:34.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7212025-02-23T09:15:34.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7222025-02-23T09:15:34.900ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.079008ms iteration = 15 status = {}
7232025-02-23T09:15:34.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0588f820-2574-4475-a942-88cdd13d93c5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
7242025-02-23T09:15:34.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0588f820-2574-4475-a942-88cdd13d93c5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
7252025-02-23T09:15:34.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7262025-02-23T09:15:34.920ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "107e7234-d056-4d93-9375-f6309c733dd2", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7272025-02-23T09:15:34.920ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7282025-02-23T09:15:34.921ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "890c101c-0caa-4501-9c46-331edcab5a4e", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7292025-02-23T09:15:34.921ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7302025-02-23T09:15:34.923ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7312025-02-23T09:15:34.923ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 397.126992ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7322025-02-23T09:15:34.937ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7332025-02-23T09:15:34.937ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "24be1cb0-2679-4a80-bcf9-4fff0cf49d25", "content-length": "2", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
7342025-02-23T09:15:34.939ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7352025-02-23T09:15:34.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7362025-02-23T09:15:34.969ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7372025-02-23T09:15:34.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7382025-02-23T09:15:34.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0a9aa7-fc9d-4757-b514-464e9412d7b2", "content-length": "372", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
7392025-02-23T09:15:34.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7402025-02-23T09:15:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7412025-02-23T09:15:34.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 55350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0588f820-2574-4475-a942-88cdd13d93c5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
7422025-02-23T09:15:34.971ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 446.23519ms iteration = 15 status = null
7432025-02-23T09:15:35.017ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7442025-02-23T09:15:35.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7452025-02-23T09:15:35.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7aab3d0f-ce67-4ec0-a205-416adf714c85", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
7462025-02-23T09:15:35.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7472025-02-23T09:15:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7482025-02-23T09:15:35.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7492025-02-23T09:15:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7502025-02-23T09:15:35.035ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7512025-02-23T09:15:35.101ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7522025-02-23T09:15:35.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7532025-02-23T09:15:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7542025-02-23T09:15:35.108ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7552025-02-23T09:15:35.108ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7562025-02-23T09:15:35.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7572025-02-23T09:15:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7582025-02-23T09:15:35.143ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
7592025-02-23T09:15:35.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7602025-02-23T09:15:35.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7612025-02-23T09:15:35.144ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7622025-02-23T09:15:35.145ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "acfcc54d-d903-4586-bc7a-ec6a011e86b1", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7632025-02-23T09:15:35.145ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7642025-02-23T09:15:35.146ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "833a4077-80bf-49ea-9135-c11744f2a190", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7652025-02-23T09:15:35.146ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7662025-02-23T09:15:35.148ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a2a2d55b-b9dd-4658-8d7d-3cc42f5e249b", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7672025-02-23T09:15:35.148ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7682025-02-23T09:15:35.150ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7692025-02-23T09:15:35.150ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 624.008996ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7702025-02-23T09:15:35.155ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7712025-02-23T09:15:35.155ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "978134c7-83b4-41cb-bff8-23429094d98c", "content-length": "134", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
7722025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7732025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
7742025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7752025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7762025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7772025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7782025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7792025-02-23T09:15:35.155ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7802025-02-23T09:15:35.156ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7812025-02-23T09:15:35.156ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7822025-02-23T09:15:35.156ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
7832025-02-23T09:15:35.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7842025-02-23T09:15:35.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7852025-02-23T09:15:35.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "78e7db7a-b7d8-4764-b666-9f06d490f702", "content-length": "691", "date": "Sun, 23 Feb 2025 09:15:35 GMT"} })
7862025-02-23T09:15:35.157ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7872025-02-23T09:15:35.157ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7882025-02-23T09:15:35.157ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7892025-02-23T09:15:35.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e192e0ef-4577-4202-8edd-d0de73a59654", "date": "Sun, 23 Feb 2025 09:15:35 GMT"} })
7902025-02-23T09:15:35.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7912025-02-23T09:15:35.159ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 633.243748ms iteration = 15 status = {}
7922025-02-23T09:15:35.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e850fc22-f7e4-4206-b946-c0a067e41588", "content-length": "2", "date": "Sun, 23 Feb 2025 09:15:34 GMT"} })
7932025-02-23T09:15:35.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7942025-02-23T09:15:35.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8111b460-a9bb-4630-ac2d-8646b8ed0976", "content-length": "52", "date": "Sun, 23 Feb 2025 09:15:35 GMT"} })
7952025-02-23T09:15:35.159ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
7962025-02-23T09:15:35.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7972025-02-23T09:15:35.159ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 634.019043ms iteration = 15 status = {}
7982025-02-23T09:15:35.253ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c6a456af-d8c6-43dd-8c58-11e0b57fa5ef", "date": "Sun, 23 Feb 2025 09:15:35 GMT"} })
7992025-02-23T09:15:35.253ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
8002025-02-23T09:15:35.253ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8012025-02-23T09:15:35.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "396ce289-3690-4b3e-a525-07d8d06ecd95", "content-length": "682", "date": "Sun, 23 Feb 2025 09:15:35 GMT"} })
8022025-02-23T09:15:35.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8032025-02-23T09:15:35.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8042025-02-23T09:15:35.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8052025-02-23T09:15:35.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8062025-02-23T09:15:35.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8072025-02-23T09:15:35.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8082025-02-23T09:15:35.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8092025-02-23T09:15:35.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8102025-02-23T09:15:35.273ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 747.275013ms iteration = 15 status = {}
8112025-02-23T09:15:35.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c0e34bad-90a7-476e-8be1-af74df3047d0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8122025-02-23T09:15:35.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c0e34bad-90a7-476e-8be1-af74df3047d0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8132025-02-23T09:15:35.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c0e34bad-90a7-476e-8be1-af74df3047d0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8142025-02-23T09:15:36.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = a41cd550-b4c4-4a00-b253-a7ae408a2a92 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
8152025-02-23T09:15:36.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = a41cd550-b4c4-4a00-b253-a7ae408a2a92 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
8162025-02-23T09:15:36.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = a41cd550-b4c4-4a00-b253-a7ae408a2a92 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
8172025-02-23T09:15:37.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 33c3943b-32f4-4432-afc0-547ed485485e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8182025-02-23T09:15:37.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 33c3943b-32f4-4432-afc0-547ed485485e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8192025-02-23T09:15:37.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 33c3943b-32f4-4432-afc0-547ed485485e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8202025-02-23T09:15:37.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 601 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 4b758d3e-6b21-4600-83fa-f0a212b465fa response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
8212025-02-23T09:15:38.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 371137a3-c41c-437f-b507-c7b053fdadd3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8222025-02-23T09:15:38.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 371137a3-c41c-437f-b507-c7b053fdadd3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8232025-02-23T09:15:38.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 371137a3-c41c-437f-b507-c7b053fdadd3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8242025-02-23T09:15:39.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b49759a-7dc2-40c0-acd5-cd2c7f20100b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8252025-02-23T09:15:39.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b49759a-7dc2-40c0-acd5-cd2c7f20100b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8262025-02-23T09:15:39.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b49759a-7dc2-40c0-acd5-cd2c7f20100b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8272025-02-23T09:15:40.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5c136e79-d415-4424-92d5-37dc54d46803 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8282025-02-23T09:15:40.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5c136e79-d415-4424-92d5-37dc54d46803 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8292025-02-23T09:15:40.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5c136e79-d415-4424-92d5-37dc54d46803 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8302025-02-23T09:15:41.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 873d01d3-6ddb-4813-801a-6c5c107adc2a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8312025-02-23T09:15:41.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 873d01d3-6ddb-4813-801a-6c5c107adc2a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8322025-02-23T09:15:41.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 873d01d3-6ddb-4813-801a-6c5c107adc2a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8332025-02-23T09:15:42.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a969cb2-7a92-4131-8dba-bda6c9cfee0c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8342025-02-23T09:15:42.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a969cb2-7a92-4131-8dba-bda6c9cfee0c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8352025-02-23T09:15:42.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a969cb2-7a92-4131-8dba-bda6c9cfee0c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8362025-02-23T09:15:43.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4f4d8cdd-4209-4efc-b87d-c6592fc7fafe roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8372025-02-23T09:15:43.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4f4d8cdd-4209-4efc-b87d-c6592fc7fafe resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8382025-02-23T09:15:43.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4f4d8cdd-4209-4efc-b87d-c6592fc7fafe response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8392025-02-23T09:15:44.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9bbd1516-8cac-4936-84eb-48e93afe9903 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8402025-02-23T09:15:44.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9bbd1516-8cac-4936-84eb-48e93afe9903 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8412025-02-23T09:15:44.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9bbd1516-8cac-4936-84eb-48e93afe9903 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8422025-02-23T09:15:44.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
8432025-02-23T09:15:44.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
8442025-02-23T09:15:44.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8452025-02-23T09:15:44.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8462025-02-23T09:15:44.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8472025-02-23T09:15:44.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8482025-02-23T09:15:44.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8492025-02-23T09:15:44.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8502025-02-23T09:15:44.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8512025-02-23T09:15:44.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.497225ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8522025-02-23T09:15:44.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8532025-02-23T09:15:44.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8542025-02-23T09:15:44.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8552025-02-23T09:15:44.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8562025-02-23T09:15:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8572025-02-23T09:15:44.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8582025-02-23T09:15:44.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
8592025-02-23T09:15:44.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8602025-02-23T09:15:44.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8612025-02-23T09:15:44.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
8622025-02-23T09:15:44.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.477085ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
8632025-02-23T09:15:45.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e5f645b5-0ecc-415a-9fc3-d5f33326603b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8642025-02-23T09:15:45.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e5f645b5-0ecc-415a-9fc3-d5f33326603b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8652025-02-23T09:15:45.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e5f645b5-0ecc-415a-9fc3-d5f33326603b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8662025-02-23T09:15:46.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7b58c47c-ea93-463c-9f0e-3a74defffce6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8672025-02-23T09:15:46.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7b58c47c-ea93-463c-9f0e-3a74defffce6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8682025-02-23T09:15:46.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7b58c47c-ea93-463c-9f0e-3a74defffce6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8692025-02-23T09:15:47.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9d860b95-5583-469b-9c61-0dbf4014475b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8702025-02-23T09:15:47.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9d860b95-5583-469b-9c61-0dbf4014475b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8712025-02-23T09:15:47.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9d860b95-5583-469b-9c61-0dbf4014475b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8722025-02-23T09:15:47.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = d5c23b3b-fcdf-4c4a-b2f1-a0a6c1bc63f7 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
8732025-02-23T09:15:47.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = d5c23b3b-fcdf-4c4a-b2f1-a0a6c1bc63f7 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
8742025-02-23T09:15:47.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = d5c23b3b-fcdf-4c4a-b2f1-a0a6c1bc63f7 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
8752025-02-23T09:15:47.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = de0048b7-e6a4-4127-8317-11c2983ab237 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
8762025-02-23T09:15:47.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = de0048b7-e6a4-4127-8317-11c2983ab237 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
8772025-02-23T09:15:47.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = de0048b7-e6a4-4127-8317-11c2983ab237 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
8782025-02-23T09:15:47.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = ee609662-958e-4eff-a880-18b20c44d198 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
8792025-02-23T09:15:48.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e73ae5ba-6934-44c8-87a8-5c4d98e53427 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8802025-02-23T09:15:48.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e73ae5ba-6934-44c8-87a8-5c4d98e53427 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8812025-02-23T09:15:48.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e73ae5ba-6934-44c8-87a8-5c4d98e53427 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8822025-02-23T09:15:49.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a494264-ed90-41fb-8833-bcfed54715cc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8832025-02-23T09:15:49.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a494264-ed90-41fb-8833-bcfed54715cc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8842025-02-23T09:15:49.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a494264-ed90-41fb-8833-bcfed54715cc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8852025-02-23T09:15:50.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a375e06f-6662-4df8-9727-2b838e847c4c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8862025-02-23T09:15:50.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a375e06f-6662-4df8-9727-2b838e847c4c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8872025-02-23T09:15:50.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a375e06f-6662-4df8-9727-2b838e847c4c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8882025-02-23T09:15:51.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cfb89777-14bb-4ba8-bf95-d512b5ac68f0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8892025-02-23T09:15:51.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cfb89777-14bb-4ba8-bf95-d512b5ac68f0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8902025-02-23T09:15:51.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cfb89777-14bb-4ba8-bf95-d512b5ac68f0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8912025-02-23T09:15:52.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 27d8cb08-f66b-4797-81e5-c87da6569505 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8922025-02-23T09:15:52.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 27d8cb08-f66b-4797-81e5-c87da6569505 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8932025-02-23T09:15:52.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 27d8cb08-f66b-4797-81e5-c87da6569505 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8942025-02-23T09:15:53.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dd761b97-a05c-436b-aabb-b074b1d21908 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8952025-02-23T09:15:53.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dd761b97-a05c-436b-aabb-b074b1d21908 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8962025-02-23T09:15:53.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dd761b97-a05c-436b-aabb-b074b1d21908 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8972025-02-23T09:15:54.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6a5e2943-ec85-44b2-adfc-48e2fa09bced roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8982025-02-23T09:15:54.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6a5e2943-ec85-44b2-adfc-48e2fa09bced resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8992025-02-23T09:15:54.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6a5e2943-ec85-44b2-adfc-48e2fa09bced response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9002025-02-23T09:15:54.525ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
9012025-02-23T09:15:54.525ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
9022025-02-23T09:15:54.525ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9032025-02-23T09:15:54.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9042025-02-23T09:15:54.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052025-02-23T09:15:54.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9062025-02-23T09:15:54.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072025-02-23T09:15:54.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9082025-02-23T09:15:54.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9092025-02-23T09:15:54.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.856813ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9102025-02-23T09:15:54.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9112025-02-23T09:15:54.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9122025-02-23T09:15:54.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9132025-02-23T09:15:54.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9142025-02-23T09:15:54.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9152025-02-23T09:15:54.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9162025-02-23T09:15:54.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
9172025-02-23T09:15:54.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9182025-02-23T09:15:54.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9192025-02-23T09:15:54.544ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
9202025-02-23T09:15:54.544ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.017516ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
9212025-02-23T09:15:55.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7d25879e-894e-45c3-9e05-653512fcc547 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9222025-02-23T09:15:55.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7d25879e-894e-45c3-9e05-653512fcc547 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9232025-02-23T09:15:55.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7d25879e-894e-45c3-9e05-653512fcc547 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9242025-02-23T09:15:56.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 87a44e5e-8082-4dd6-9a69-76567da33329 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9252025-02-23T09:15:56.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 87a44e5e-8082-4dd6-9a69-76567da33329 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9262025-02-23T09:15:56.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 87a44e5e-8082-4dd6-9a69-76567da33329 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9272025-02-23T09:15:57.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = b9fd1a9e-aed6-4346-80c7-b2875038391b response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
9282025-02-23T09:15:57.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f06c4503-37db-4de9-a770-2c03c7ab810f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9292025-02-23T09:15:57.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f06c4503-37db-4de9-a770-2c03c7ab810f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9302025-02-23T09:15:57.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f06c4503-37db-4de9-a770-2c03c7ab810f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9312025-02-23T09:15:58.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 26a20279-3f54-4cf1-ab6e-4f57a55c8cf5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9322025-02-23T09:15:58.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 26a20279-3f54-4cf1-ab6e-4f57a55c8cf5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9332025-02-23T09:15:58.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 26a20279-3f54-4cf1-ab6e-4f57a55c8cf5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9342025-02-23T09:15:59.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2671a9b5-4ec7-4320-bf20-0c65cf252ff8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9352025-02-23T09:15:59.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2671a9b5-4ec7-4320-bf20-0c65cf252ff8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9362025-02-23T09:15:59.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2671a9b5-4ec7-4320-bf20-0c65cf252ff8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9372025-02-23T09:16:00.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 87305ee3-6a48-4013-ac63-e76427b47d17 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9382025-02-23T09:16:00.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 87305ee3-6a48-4013-ac63-e76427b47d17 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9392025-02-23T09:16:00.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 87305ee3-6a48-4013-ac63-e76427b47d17 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9402025-02-23T09:16:01.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e80101fa-7c13-4cb2-9311-60c968dc1035 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9412025-02-23T09:16:01.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e80101fa-7c13-4cb2-9311-60c968dc1035 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9422025-02-23T09:16:01.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e80101fa-7c13-4cb2-9311-60c968dc1035 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9432025-02-23T09:16:02.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ab4a62f-ef19-4c75-adf0-8a423e8869f0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9442025-02-23T09:16:02.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ab4a62f-ef19-4c75-adf0-8a423e8869f0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9452025-02-23T09:16:02.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ab4a62f-ef19-4c75-adf0-8a423e8869f0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9462025-02-23T09:16:03.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f2abd2bf-ad6d-4974-9391-71d2255dc666 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9472025-02-23T09:16:03.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f2abd2bf-ad6d-4974-9391-71d2255dc666 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9482025-02-23T09:16:03.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f2abd2bf-ad6d-4974-9391-71d2255dc666 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9492025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
9502025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9512025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
9522025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9532025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
9542025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9552025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
9562025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
9572025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9582025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9592025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
9602025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
9612025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
9622025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9632025-02-23T09:16:04.526ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
9642025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
9652025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9662025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
9672025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
9682025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9692025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9702025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9712025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
9722025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9732025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
9742025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
9752025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9762025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9772025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9782025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
9792025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9802025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9812025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9822025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
9832025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
9842025-02-23T09:16:04.527ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9852025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9862025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9872025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
9882025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
9892025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9902025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9912025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
9922025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9932025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9942025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
9952025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9962025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9972025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9982025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9992025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10002025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10012025-02-23T09:16:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10022025-02-23T09:16:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10032025-02-23T09:16:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10042025-02-23T09:16:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10052025-02-23T09:16:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10062025-02-23T09:16:04.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10072025-02-23T09:16:04.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10082025-02-23T09:16:04.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10092025-02-23T09:16:04.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10102025-02-23T09:16:04.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.777275ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
10112025-02-23T09:16:04.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.151071ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10122025-02-23T09:16:04.536ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132025-02-23T09:16:04.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10142025-02-23T09:16:04.536ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 9.508358ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
10152025-02-23T09:16:04.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10162025-02-23T09:16:04.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172025-02-23T09:16:04.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10182025-02-23T09:16:04.538ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10192025-02-23T09:16:04.538ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10202025-02-23T09:16:04.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10212025-02-23T09:16:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10222025-02-23T09:16:04.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35980, tv_nsec: 241012742 } })
10232025-02-23T09:16:04.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
10242025-02-23T09:16:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10252025-02-23T09:16:04.540ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10262025-02-23T09:16:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10272025-02-23T09:16:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10282025-02-23T09:16:04.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10292025-02-23T09:16:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10302025-02-23T09:16:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10312025-02-23T09:16:04.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10322025-02-23T09:16:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10332025-02-23T09:16:04.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342025-02-23T09:16:04.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10352025-02-23T09:16:04.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10362025-02-23T09:16:04.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372025-02-23T09:16:04.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.19161ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
10382025-02-23T09:16:04.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10392025-02-23T09:16:04.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10402025-02-23T09:16:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10412025-02-23T09:16:04.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10422025-02-23T09:16:04.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10432025-02-23T09:16:04.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10442025-02-23T09:16:04.548ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10452025-02-23T09:16:04.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462025-02-23T09:16:04.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35980, tv_nsec: 249206845 } })
10472025-02-23T09:16:04.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10482025-02-23T09:16:04.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
10492025-02-23T09:16:04.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 22.565432ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10502025-02-23T09:16:04.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 35980, tv_nsec: 250678113 } })
10512025-02-23T09:16:04.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
10522025-02-23T09:16:04.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10532025-02-23T09:16:04.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10542025-02-23T09:16:04.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10552025-02-23T09:16:04.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10562025-02-23T09:16:04.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10572025-02-23T09:16:04.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10582025-02-23T09:16:04.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10592025-02-23T09:16:04.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10602025-02-23T09:16:04.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10612025-02-23T09:16:04.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10622025-02-23T09:16:04.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10632025-02-23T09:16:04.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.187269ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10642025-02-23T09:16:04.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652025-02-23T09:16:04.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10662025-02-23T09:16:04.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10672025-02-23T09:16:04.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10682025-02-23T09:16:04.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10692025-02-23T09:16:04.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10702025-02-23T09:16:04.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10712025-02-23T09:16:04.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
10722025-02-23T09:16:04.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10732025-02-23T09:16:04.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10742025-02-23T09:16:04.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10752025-02-23T09:16:04.571ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10762025-02-23T09:16:04.571ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.583075ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10772025-02-23T09:16:04.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10782025-02-23T09:16:04.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10792025-02-23T09:16:04.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10802025-02-23T09:16:04.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10812025-02-23T09:16:04.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10822025-02-23T09:16:04.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.846032ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10832025-02-23T09:16:04.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10842025-02-23T09:16:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10852025-02-23T09:16:04.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10862025-02-23T09:16:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10872025-02-23T09:16:04.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
10882025-02-23T09:16:04.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.03407ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
10892025-02-23T09:16:04.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1ecb5f78-7de2-49d6-b169-a955b72289d3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10902025-02-23T09:16:04.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1ecb5f78-7de2-49d6-b169-a955b72289d3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10912025-02-23T09:16:04.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922025-02-23T09:16:04.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1ecb5f78-7de2-49d6-b169-a955b72289d3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10932025-02-23T09:16:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
10942025-02-23T09:16:04.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10952025-02-23T09:16:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10962025-02-23T09:16:04.614ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.992908ms iteration = 16 status = 0
10972025-02-23T09:16:04.621ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10982025-02-23T09:16:04.621ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10992025-02-23T09:16:04.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11002025-02-23T09:16:04.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11012025-02-23T09:16:04.624ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11022025-02-23T09:16:04.624ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11032025-02-23T09:16:04.624ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.918824ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11042025-02-23T09:16:04.625ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11052025-02-23T09:16:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11062025-02-23T09:16:04.627ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072025-02-23T09:16:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11082025-02-23T09:16:04.629ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11092025-02-23T09:16:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11102025-02-23T09:16:04.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.072938ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11112025-02-23T09:16:04.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
11122025-02-23T09:16:04.633ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11132025-02-23T09:16:04.634ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11f6b397-5b69-4d6e-b7c7-935f25ac3176", "content-length": "26", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11142025-02-23T09:16:04.634ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11152025-02-23T09:16:04.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11162025-02-23T09:16:04.645ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.507908ms iteration = 18 status = {"physical_disks_added":0}
11172025-02-23T09:16:04.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
11182025-02-23T09:16:04.654ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11192025-02-23T09:16:04.654ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1e10991-60ef-4b7a-9501-4ffdc93c878c", "content-length": "26", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11202025-02-23T09:16:04.654ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11212025-02-23T09:16:04.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11222025-02-23T09:16:04.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
11232025-02-23T09:16:04.664ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11242025-02-23T09:16:04.664ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fc5babb-524b-4066-bb8e-3f8b9ddb37e4", "content-length": "26", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11252025-02-23T09:16:04.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11262025-02-23T09:16:04.666ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
11272025-02-23T09:16:04.666ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 139.124583ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
11282025-02-23T09:16:04.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
11292025-02-23T09:16:04.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11302025-02-23T09:16:04.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11312025-02-23T09:16:04.715ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11322025-02-23T09:16:04.715ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "46431246-7d90-46ac-ae70-a8b0046eb825", "content-length": "2", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11332025-02-23T09:16:04.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342025-02-23T09:16:04.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11352025-02-23T09:16:04.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11362025-02-23T09:16:04.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11372025-02-23T09:16:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11382025-02-23T09:16:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11392025-02-23T09:16:04.721ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.495181ms iteration = 16 status = null
11402025-02-23T09:16:04.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412025-02-23T09:16:04.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11422025-02-23T09:16:04.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11432025-02-23T09:16:04.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11442025-02-23T09:16:04.740ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 213.278111ms iteration = 16 status = {}
11452025-02-23T09:16:04.754ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11462025-02-23T09:16:04.754ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11472025-02-23T09:16:04.754ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6e77e3d-e570-4893-adb8-24e30bbd671c", "content-length": "372", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11482025-02-23T09:16:04.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11492025-02-23T09:16:04.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11502025-02-23T09:16:04.773ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
11512025-02-23T09:16:04.773ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11522025-02-23T09:16:04.773ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "463143f4-76e2-4dec-962a-5d90bfc60146", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11532025-02-23T09:16:04.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11542025-02-23T09:16:04.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11552025-02-23T09:16:04.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11562025-02-23T09:16:04.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11572025-02-23T09:16:04.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11582025-02-23T09:16:04.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11592025-02-23T09:16:04.781ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11602025-02-23T09:16:04.781ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11612025-02-23T09:16:04.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11622025-02-23T09:16:04.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11632025-02-23T09:16:04.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11642025-02-23T09:16:04.834ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
11652025-02-23T09:16:04.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11662025-02-23T09:16:04.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11672025-02-23T09:16:04.842ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11682025-02-23T09:16:04.842ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f84910c-471f-4ed8-97fa-2ed2fe6f5b82", "content-length": "134", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11692025-02-23T09:16:04.842ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11702025-02-23T09:16:04.842ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
11712025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11722025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11732025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11742025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11752025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11762025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11772025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11782025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11792025-02-23T09:16:04.843ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
11802025-02-23T09:16:04.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11812025-02-23T09:16:04.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11822025-02-23T09:16:04.846ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11832025-02-23T09:16:04.846ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dbce0a9-194c-4a42-a38e-e5d9a9a0fd66", "content-length": "2", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11842025-02-23T09:16:04.846ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11852025-02-23T09:16:04.846ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4db5d0e3-e0bd-4327-9f85-98c9bfbe62e4", "content-length": "52", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11862025-02-23T09:16:04.846ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
11872025-02-23T09:16:04.846ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11882025-02-23T09:16:04.881ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e775873d-01fe-4d88-b5c3-9ac40d2ba468", "content-length": "691", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11892025-02-23T09:16:04.881ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11902025-02-23T09:16:04.881ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11912025-02-23T09:16:04.881ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11922025-02-23T09:16:04.882ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 355.219927ms iteration = 16 status = {}
11932025-02-23T09:16:04.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0bd1173-616b-463f-adba-652b82abd168", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11942025-02-23T09:16:04.887ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.778872ms iteration = 16 status = {}
11952025-02-23T09:16:04.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ec6d71c2-105c-412b-9a4a-8e5c87ef0125", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11962025-02-23T09:16:04.973ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
11972025-02-23T09:16:04.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11982025-02-23T09:16:04.977ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad925676-a80e-47c5-951f-6e9ba974688c", "content-length": "682", "date": "Sun, 23 Feb 2025 09:16:04 GMT"} })
11992025-02-23T09:16:04.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12002025-02-23T09:16:04.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12012025-02-23T09:16:04.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12022025-02-23T09:16:04.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12032025-02-23T09:16:04.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12042025-02-23T09:16:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12052025-02-23T09:16:04.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12062025-02-23T09:16:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12072025-02-23T09:16:04.995ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.331813ms iteration = 16 status = {}
12082025-02-23T09:16:05.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 036ec85d-32b5-4831-aecb-af6999f52966 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12092025-02-23T09:16:05.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 036ec85d-32b5-4831-aecb-af6999f52966 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12102025-02-23T09:16:05.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 036ec85d-32b5-4831-aecb-af6999f52966 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12112025-02-23T09:16:06.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 28b1027c-ca7c-4f2b-bcb3-5d167f915145 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
12122025-02-23T09:16:06.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 28b1027c-ca7c-4f2b-bcb3-5d167f915145 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
12132025-02-23T09:16:06.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 28b1027c-ca7c-4f2b-bcb3-5d167f915145 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
12142025-02-23T09:16:06.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f8e0f218-87b8-4c06-a340-5922d885d31a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12152025-02-23T09:16:06.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f8e0f218-87b8-4c06-a340-5922d885d31a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12162025-02-23T09:16:06.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f8e0f218-87b8-4c06-a340-5922d885d31a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12172025-02-23T09:16:07.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 506 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = e5c134a6-67d3-4dea-bbfd-642ed115ed15 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
12182025-02-23T09:16:07.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c3e3b610-b5bb-45a2-9991-8dea3d4f8f66 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12192025-02-23T09:16:07.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c3e3b610-b5bb-45a2-9991-8dea3d4f8f66 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12202025-02-23T09:16:07.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c3e3b610-b5bb-45a2-9991-8dea3d4f8f66 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12212025-02-23T09:16:08.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9ff85ada-a115-48a0-949d-bd1cb2c37658 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12222025-02-23T09:16:08.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9ff85ada-a115-48a0-949d-bd1cb2c37658 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12232025-02-23T09:16:08.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9ff85ada-a115-48a0-949d-bd1cb2c37658 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12242025-02-23T09:16:09.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7501685a-cc74-41d7-ba3c-5f19985c4954 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12252025-02-23T09:16:09.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7501685a-cc74-41d7-ba3c-5f19985c4954 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12262025-02-23T09:16:09.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7501685a-cc74-41d7-ba3c-5f19985c4954 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12272025-02-23T09:16:10.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = de3ef5cd-7c68-4f6e-8ee3-9c7f671c1694 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12282025-02-23T09:16:10.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = de3ef5cd-7c68-4f6e-8ee3-9c7f671c1694 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12292025-02-23T09:16:10.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = de3ef5cd-7c68-4f6e-8ee3-9c7f671c1694 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12302025-02-23T09:16:11.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 474c30b5-573a-4517-8bb4-a5f2be86efac roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12312025-02-23T09:16:11.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 474c30b5-573a-4517-8bb4-a5f2be86efac resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12322025-02-23T09:16:11.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 474c30b5-573a-4517-8bb4-a5f2be86efac response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12332025-02-23T09:16:12.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 85e9608e-646e-45ee-a348-0747c37c7756 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12342025-02-23T09:16:12.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 85e9608e-646e-45ee-a348-0747c37c7756 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12352025-02-23T09:16:12.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 85e9608e-646e-45ee-a348-0747c37c7756 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12362025-02-23T09:16:13.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b911ddc0-aa12-43eb-889c-31dad8de7e56 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12372025-02-23T09:16:13.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b911ddc0-aa12-43eb-889c-31dad8de7e56 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12382025-02-23T09:16:13.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b911ddc0-aa12-43eb-889c-31dad8de7e56 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12392025-02-23T09:16:14.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
12402025-02-23T09:16:14.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
12412025-02-23T09:16:14.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12422025-02-23T09:16:14.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12432025-02-23T09:16:14.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442025-02-23T09:16:14.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12452025-02-23T09:16:14.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12462025-02-23T09:16:14.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12472025-02-23T09:16:14.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12482025-02-23T09:16:14.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12492025-02-23T09:16:14.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12502025-02-23T09:16:14.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12512025-02-23T09:16:14.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12522025-02-23T09:16:14.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
12532025-02-23T09:16:14.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12542025-02-23T09:16:14.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12552025-02-23T09:16:14.546ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
12562025-02-23T09:16:14.546ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.679597ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
12572025-02-23T09:16:14.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12582025-02-23T09:16:14.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12592025-02-23T09:16:14.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.296887ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12602025-02-23T09:16:14.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 17cf908b-c166-4e05-8575-71287a2f23e3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12612025-02-23T09:16:14.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 17cf908b-c166-4e05-8575-71287a2f23e3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12622025-02-23T09:16:14.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 17cf908b-c166-4e05-8575-71287a2f23e3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12632025-02-23T09:16:15.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 750cf91b-1556-4252-a042-67e353580220 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12642025-02-23T09:16:15.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 750cf91b-1556-4252-a042-67e353580220 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12652025-02-23T09:16:15.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 750cf91b-1556-4252-a042-67e353580220 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12662025-02-23T09:16:16.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 59c96b4d-a789-4fcf-9878-a06e426605a8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12672025-02-23T09:16:16.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 59c96b4d-a789-4fcf-9878-a06e426605a8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12682025-02-23T09:16:16.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 59c96b4d-a789-4fcf-9878-a06e426605a8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12692025-02-23T09:16:17.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 198962c9-bd85-4557-abac-e5e92170db2c roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
12702025-02-23T09:16:17.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 198962c9-bd85-4557-abac-e5e92170db2c resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
12712025-02-23T09:16:17.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 198962c9-bd85-4557-abac-e5e92170db2c response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
12722025-02-23T09:16:17.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 583ca7f1-eb27-4b4c-b806-c66b12779cfe roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
12732025-02-23T09:16:17.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 583ca7f1-eb27-4b4c-b806-c66b12779cfe resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
12742025-02-23T09:16:17.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 583ca7f1-eb27-4b4c-b806-c66b12779cfe response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
12752025-02-23T09:16:17.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = d3c45e18-b441-45a0-a376-d85c89934808 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
12762025-02-23T09:16:17.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 920f5755-db8a-4269-aae7-e137297f1635 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12772025-02-23T09:16:17.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 920f5755-db8a-4269-aae7-e137297f1635 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12782025-02-23T09:16:17.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 920f5755-db8a-4269-aae7-e137297f1635 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12792025-02-23T09:16:18.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 09a54d2b-5a5c-4615-9938-302fdd015ced roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12802025-02-23T09:16:18.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 09a54d2b-5a5c-4615-9938-302fdd015ced resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12812025-02-23T09:16:18.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 09a54d2b-5a5c-4615-9938-302fdd015ced response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12822025-02-23T09:16:19.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3891d652-4ccc-4369-b848-ca6213276525 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12832025-02-23T09:16:19.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3891d652-4ccc-4369-b848-ca6213276525 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12842025-02-23T09:16:19.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3891d652-4ccc-4369-b848-ca6213276525 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12852025-02-23T09:16:20.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2222ffcb-e47a-4109-841e-2bf571ac6d69 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12862025-02-23T09:16:20.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2222ffcb-e47a-4109-841e-2bf571ac6d69 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12872025-02-23T09:16:20.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2222ffcb-e47a-4109-841e-2bf571ac6d69 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12882025-02-23T09:16:21.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 56e6ff81-055a-4ca8-a439-4d350b4d6579 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12892025-02-23T09:16:21.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 56e6ff81-055a-4ca8-a439-4d350b4d6579 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12902025-02-23T09:16:21.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 56e6ff81-055a-4ca8-a439-4d350b4d6579 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12912025-02-23T09:16:23.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0822e466-1775-44c6-acbd-63a15ee9b0f6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12922025-02-23T09:16:23.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0822e466-1775-44c6-acbd-63a15ee9b0f6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12932025-02-23T09:16:23.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0822e466-1775-44c6-acbd-63a15ee9b0f6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12942025-02-23T09:16:24.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0ed7481b-9db0-4904-9ed3-ff44bc19cb1f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12952025-02-23T09:16:24.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0ed7481b-9db0-4904-9ed3-ff44bc19cb1f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12962025-02-23T09:16:24.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0ed7481b-9db0-4904-9ed3-ff44bc19cb1f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
12972025-02-23T09:16:24.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
12982025-02-23T09:16:24.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
12992025-02-23T09:16:24.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13002025-02-23T09:16:24.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13012025-02-23T09:16:24.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13022025-02-23T09:16:24.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13032025-02-23T09:16:24.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13042025-02-23T09:16:24.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052025-02-23T09:16:24.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13062025-02-23T09:16:24.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.363043ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13072025-02-23T09:16:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13082025-02-23T09:16:24.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13092025-02-23T09:16:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13102025-02-23T09:16:24.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13112025-02-23T09:16:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13122025-02-23T09:16:24.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132025-02-23T09:16:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
13142025-02-23T09:16:24.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13152025-02-23T09:16:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13162025-02-23T09:16:24.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
13172025-02-23T09:16:24.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.384435ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
13182025-02-23T09:16:25.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 611ccabb-5e00-4c50-80ec-e7dae9dd2783 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13192025-02-23T09:16:25.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 611ccabb-5e00-4c50-80ec-e7dae9dd2783 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13202025-02-23T09:16:25.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 611ccabb-5e00-4c50-80ec-e7dae9dd2783 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13212025-02-23T09:16:26.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4455e8b5-bf33-4558-bd69-b549c8d36f28 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13222025-02-23T09:16:26.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4455e8b5-bf33-4558-bd69-b549c8d36f28 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13232025-02-23T09:16:26.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4455e8b5-bf33-4558-bd69-b549c8d36f28 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13242025-02-23T09:16:27.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6c35e1bb-b78f-4cbe-bf31-d3222667711c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13252025-02-23T09:16:27.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6c35e1bb-b78f-4cbe-bf31-d3222667711c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13262025-02-23T09:16:27.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6c35e1bb-b78f-4cbe-bf31-d3222667711c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13272025-02-23T09:16:27.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 631 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 3c97488b-b6e5-4bb5-b497-41397ee3fcad response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
13282025-02-23T09:16:28.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 60b23dae-c231-4403-a5fd-491670f77326 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13292025-02-23T09:16:28.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 60b23dae-c231-4403-a5fd-491670f77326 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13302025-02-23T09:16:28.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 60b23dae-c231-4403-a5fd-491670f77326 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13312025-02-23T09:16:29.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ac8a73e8-e2db-4722-9f78-7d3e3f9d349f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13322025-02-23T09:16:29.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ac8a73e8-e2db-4722-9f78-7d3e3f9d349f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13332025-02-23T09:16:29.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ac8a73e8-e2db-4722-9f78-7d3e3f9d349f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13342025-02-23T09:16:30.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b6144084-c499-4dc3-b317-a1477e81bef7 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13352025-02-23T09:16:30.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b6144084-c499-4dc3-b317-a1477e81bef7 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13362025-02-23T09:16:30.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b6144084-c499-4dc3-b317-a1477e81bef7 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13372025-02-23T09:16:31.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a8be2404-c44e-43fd-8865-5cfca3f59412 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13382025-02-23T09:16:31.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a8be2404-c44e-43fd-8865-5cfca3f59412 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13392025-02-23T09:16:31.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a8be2404-c44e-43fd-8865-5cfca3f59412 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13402025-02-23T09:16:32.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cbcd20a5-e30d-4008-a02c-e3e1b590fd19 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13412025-02-23T09:16:32.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cbcd20a5-e30d-4008-a02c-e3e1b590fd19 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13422025-02-23T09:16:32.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cbcd20a5-e30d-4008-a02c-e3e1b590fd19 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13432025-02-23T09:16:33.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b39d6483-7eca-4ba2-967e-11d3ae71408f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13442025-02-23T09:16:33.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b39d6483-7eca-4ba2-967e-11d3ae71408f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13452025-02-23T09:16:33.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b39d6483-7eca-4ba2-967e-11d3ae71408f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13462025-02-23T09:16:34.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5030031f-ae2a-4485-abc0-6d50d9748203 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13472025-02-23T09:16:34.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5030031f-ae2a-4485-abc0-6d50d9748203 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13482025-02-23T09:16:34.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5030031f-ae2a-4485-abc0-6d50d9748203 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
13492025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
13502025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
13512025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
13522025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13532025-02-23T09:16:34.527ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:06:34.527038495 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13542025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13552025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
13562025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
13572025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13582025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13592025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
13602025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13612025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13622025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
13632025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13642025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
13652025-02-23T09:16:34.527ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13662025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13672025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
13682025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
13692025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13702025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13712025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
13722025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13732025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
13742025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13752025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
13762025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13772025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13782025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
13792025-02-23T09:16:34.527ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
13802025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.38\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
13812025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
13822025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13832025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
13842025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
13852025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
13862025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
13872025-02-23T09:16:34.527ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13882025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13892025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13902025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13912025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
13922025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13932025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13942025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
13952025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13962025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
13972025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13982025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13992025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14002025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14012025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
14022025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
14032025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14042025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
14052025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14062025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14072025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
14082025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14092025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
14102025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
14112025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14122025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14132025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14142025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
14152025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14162025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14172025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14182025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14192025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14202025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14212025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14222025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14232025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14242025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14252025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14262025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14272025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14282025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
14292025-02-23T09:16:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14302025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14312025-02-23T09:16:34.528ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 36010, tv_nsec: 228455310 } })
14322025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14332025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14342025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14352025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14362025-02-23T09:16:34.528ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 36010, tv_nsec: 228561232 } })
14372025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14382025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14392025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14402025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14412025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14422025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14432025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14442025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.216843ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14452025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
14462025-02-23T09:16:34.528ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.312164ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
14472025-02-23T09:16:34.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14482025-02-23T09:16:34.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14492025-02-23T09:16:34.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14502025-02-23T09:16:34.532ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.268129ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14512025-02-23T09:16:34.533ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:06:34.527038495 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14522025-02-23T09:16:34.533ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.336909ms iteration = 9 status = {"expiration":"2025-02-23T09:06:34.527038495Z","pruned":[]}
14532025-02-23T09:16:34.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14542025-02-23T09:16:34.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14552025-02-23T09:16:34.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14562025-02-23T09:16:34.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14572025-02-23T09:16:34.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14582025-02-23T09:16:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14592025-02-23T09:16:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14602025-02-23T09:16:34.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14612025-02-23T09:16:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14622025-02-23T09:16:34.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14632025-02-23T09:16:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14642025-02-23T09:16:34.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652025-02-23T09:16:34.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14662025-02-23T09:16:34.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14672025-02-23T09:16:34.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14682025-02-23T09:16:34.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692025-02-23T09:16:34.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702025-02-23T09:16:34.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36010, tv_nsec: 249816390 } })
14712025-02-23T09:16:34.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
14722025-02-23T09:16:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14732025-02-23T09:16:34.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14742025-02-23T09:16:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14752025-02-23T09:16:34.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14762025-02-23T09:16:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14772025-02-23T09:16:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14782025-02-23T09:16:34.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14792025-02-23T09:16:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14802025-02-23T09:16:34.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14812025-02-23T09:16:34.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14822025-02-23T09:16:34.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832025-02-23T09:16:34.568ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14842025-02-23T09:16:34.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36010, tv_nsec: 269874765 } })
14852025-02-23T09:16:34.570ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
14862025-02-23T09:16:34.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14872025-02-23T09:16:34.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14882025-02-23T09:16:34.570ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 42.955923ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
14892025-02-23T09:16:34.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14902025-02-23T09:16:34.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.006205ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
14912025-02-23T09:16:34.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14922025-02-23T09:16:34.572ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14932025-02-23T09:16:34.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14942025-02-23T09:16:34.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.525608ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
14952025-02-23T09:16:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 53.349338ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
14962025-02-23T09:16:34.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14972025-02-23T09:16:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14982025-02-23T09:16:34.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14992025-02-23T09:16:34.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15002025-02-23T09:16:34.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15012025-02-23T09:16:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15022025-02-23T09:16:34.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15032025-02-23T09:16:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15042025-02-23T09:16:34.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15052025-02-23T09:16:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15062025-02-23T09:16:34.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36010, tv_nsec: 290817287 } })
15072025-02-23T09:16:34.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
15082025-02-23T09:16:34.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15092025-02-23T09:16:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15102025-02-23T09:16:34.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15112025-02-23T09:16:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15122025-02-23T09:16:34.605ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15132025-02-23T09:16:34.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.184793ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15142025-02-23T09:16:34.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152025-02-23T09:16:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
15162025-02-23T09:16:34.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15172025-02-23T09:16:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15182025-02-23T09:16:34.629ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15192025-02-23T09:16:34.629ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15202025-02-23T09:16:34.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15212025-02-23T09:16:34.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15222025-02-23T09:16:34.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15232025-02-23T09:16:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15242025-02-23T09:16:34.639ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252025-02-23T09:16:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
15262025-02-23T09:16:34.643ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15272025-02-23T09:16:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15282025-02-23T09:16:34.656ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15292025-02-23T09:16:34.656ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15302025-02-23T09:16:34.656ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 128.538045ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15312025-02-23T09:16:34.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15322025-02-23T09:16:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15332025-02-23T09:16:34.662ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
15342025-02-23T09:16:34.662ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.986096ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
15352025-02-23T09:16:34.663ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15362025-02-23T09:16:34.663ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15372025-02-23T09:16:34.663ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 136.535095ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15382025-02-23T09:16:34.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15392025-02-23T09:16:34.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15402025-02-23T09:16:34.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15412025-02-23T09:16:34.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.059454ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15422025-02-23T09:16:34.672ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15432025-02-23T09:16:34.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15442025-02-23T09:16:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15452025-02-23T09:16:34.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15462025-02-23T09:16:34.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15472025-02-23T09:16:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15482025-02-23T09:16:34.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492025-02-23T09:16:34.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15502025-02-23T09:16:34.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15512025-02-23T09:16:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15522025-02-23T09:16:34.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 154.797007ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15532025-02-23T09:16:34.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542025-02-23T09:16:34.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15552025-02-23T09:16:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15562025-02-23T09:16:34.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15572025-02-23T09:16:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15582025-02-23T09:16:34.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15592025-02-23T09:16:34.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15602025-02-23T09:16:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15612025-02-23T09:16:34.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15622025-02-23T09:16:34.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15632025-02-23T09:16:34.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15642025-02-23T09:16:34.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15652025-02-23T09:16:34.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15662025-02-23T09:16:34.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15672025-02-23T09:16:34.699ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15682025-02-23T09:16:34.699ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15692025-02-23T09:16:34.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15702025-02-23T09:16:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15712025-02-23T09:16:34.705ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15722025-02-23T09:16:34.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 191.193448ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15732025-02-23T09:16:34.729ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15742025-02-23T09:16:34.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15752025-02-23T09:16:34.736ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15762025-02-23T09:16:34.736ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15772025-02-23T09:16:34.736ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15782025-02-23T09:16:34.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15792025-02-23T09:16:34.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15802025-02-23T09:16:34.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 209.352397ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15812025-02-23T09:16:34.738ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15822025-02-23T09:16:34.738ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15832025-02-23T09:16:34.738ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15842025-02-23T09:16:34.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15852025-02-23T09:16:34.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15862025-02-23T09:16:34.757ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
15872025-02-23T09:16:34.757ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15882025-02-23T09:16:34.757ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80c1b399-0a61-44f3-88a6-8ca67d44a74a", "content-length": "26", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
15892025-02-23T09:16:34.757ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15902025-02-23T09:16:34.759ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15912025-02-23T09:16:34.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
15922025-02-23T09:16:34.759ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15932025-02-23T09:16:34.760ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c536da4-317f-4cd2-ba9e-ecd23ce336f5", "content-length": "26", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
15942025-02-23T09:16:34.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15952025-02-23T09:16:34.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15962025-02-23T09:16:34.772ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
15972025-02-23T09:16:34.772ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15982025-02-23T09:16:34.773ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48cdcc2b-6250-4dd2-829d-ad91854689d5", "content-length": "26", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
15992025-02-23T09:16:34.773ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16002025-02-23T09:16:34.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
16012025-02-23T09:16:34.842ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 314.948074ms iteration = 19 status = {"physical_disks_added":0}
16022025-02-23T09:16:34.856ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16032025-02-23T09:16:34.856ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16042025-02-23T09:16:34.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41e654c5-7392-41ca-ab01-16b38206b164", "content-length": "372", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
16052025-02-23T09:16:34.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16062025-02-23T09:16:34.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16072025-02-23T09:16:34.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16082025-02-23T09:16:34.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16092025-02-23T09:16:34.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16102025-02-23T09:16:34.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16112025-02-23T09:16:34.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122025-02-23T09:16:34.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16132025-02-23T09:16:34.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16142025-02-23T09:16:34.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16152025-02-23T09:16:34.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16162025-02-23T09:16:34.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172025-02-23T09:16:34.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16182025-02-23T09:16:34.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16192025-02-23T09:16:34.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16202025-02-23T09:16:34.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16212025-02-23T09:16:34.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16222025-02-23T09:16:34.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16232025-02-23T09:16:34.874ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16242025-02-23T09:16:34.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2296040b-d42c-410d-9950-7fcc1b490be2", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16252025-02-23T09:16:34.875ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16262025-02-23T09:16:34.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7c5fcc1b-3f2a-4050-81af-094dd5aa77b8", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16272025-02-23T09:16:34.877ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16282025-02-23T09:16:34.879ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16292025-02-23T09:16:34.879ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16302025-02-23T09:16:34.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 352.684059ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16312025-02-23T09:16:34.900ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16322025-02-23T09:16:34.900ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16332025-02-23T09:16:34.900ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 372.99395ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16342025-02-23T09:16:34.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16352025-02-23T09:16:34.902ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.61507ms iteration = 17 status = {}
16362025-02-23T09:16:34.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372025-02-23T09:16:34.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16382025-02-23T09:16:34.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
16392025-02-23T09:16:34.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16402025-02-23T09:16:34.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16412025-02-23T09:16:34.908ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16422025-02-23T09:16:34.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16432025-02-23T09:16:34.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16442025-02-23T09:16:34.908ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4929269d-5f2b-4e70-8143-094fc1510203", "content-length": "2", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
16452025-02-23T09:16:34.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16462025-02-23T09:16:34.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16472025-02-23T09:16:34.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16482025-02-23T09:16:34.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16492025-02-23T09:16:34.911ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16502025-02-23T09:16:34.911ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) }
16512025-02-23T09:16:34.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16522025-02-23T09:16:34.911ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 384.155608ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16532025-02-23T09:16:34.911ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 384.305162ms iteration = 17 status = 0
16542025-02-23T09:16:34.913ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 386.009713ms iteration = 17 status = null
16552025-02-23T09:16:34.924ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16562025-02-23T09:16:34.924ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
16572025-02-23T09:16:34.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16582025-02-23T09:16:34.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16592025-02-23T09:16:34.925ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16602025-02-23T09:16:34.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16612025-02-23T09:16:34.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d03aae11-f328-4588-8788-9079cb654d3b", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
16622025-02-23T09:16:34.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16632025-02-23T09:16:34.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16642025-02-23T09:16:34.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652025-02-23T09:16:34.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16662025-02-23T09:16:34.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16672025-02-23T09:16:34.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16682025-02-23T09:16:34.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16692025-02-23T09:16:34.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16702025-02-23T09:16:34.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16712025-02-23T09:16:34.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16722025-02-23T09:16:34.934ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
16732025-02-23T09:16:34.934ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16742025-02-23T09:16:34.934ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
16752025-02-23T09:16:34.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 407.083227ms iteration = 9 status = {"generation":2}
16762025-02-23T09:16:34.936ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16772025-02-23T09:16:34.936ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16782025-02-23T09:16:34.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ec7ab17e-5a34-4479-8285-8f669519a2c6", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
16792025-02-23T09:16:34.938ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 411.660323ms iteration = 17 status = {}
16802025-02-23T09:16:34.951ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
16812025-02-23T09:16:34.951ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 424.213368ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
16822025-02-23T09:16:34.959ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16832025-02-23T09:16:34.959ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16842025-02-23T09:16:34.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16852025-02-23T09:16:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16862025-02-23T09:16:34.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16872025-02-23T09:16:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16882025-02-23T09:16:34.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16892025-02-23T09:16:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16902025-02-23T09:16:34.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16912025-02-23T09:16:34.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16922025-02-23T09:16:34.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
16932025-02-23T09:16:34.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 439.970923ms iteration = 9 status = {"generation":1}
16942025-02-23T09:16:34.986ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16952025-02-23T09:16:34.986ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 459.59991ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16962025-02-23T09:16:34.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16972025-02-23T09:16:34.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b4d0d990-e211-4e54-9a54-60f77cb880c2", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16982025-02-23T09:16:34.997ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16992025-02-23T09:16:34.998ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "227c070d-6b35-4329-81c9-23431b290d79", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17002025-02-23T09:16:34.998ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17012025-02-23T09:16:35.000ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "881474d2-03df-4973-a3c5-7774a89a4934", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17022025-02-23T09:16:35.000ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17032025-02-23T09:16:35.002ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17042025-02-23T09:16:35.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 475.307674ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17052025-02-23T09:16:35.042ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17062025-02-23T09:16:35.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17072025-02-23T09:16:35.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17082025-02-23T09:16:35.052ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
17092025-02-23T09:16:35.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17102025-02-23T09:16:35.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17112025-02-23T09:16:35.062ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17122025-02-23T09:16:35.062ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4424a887-317a-413f-9978-d44d304bb0b5", "content-length": "134", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
17132025-02-23T09:16:35.062ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17142025-02-23T09:16:35.062ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
17152025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17162025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17172025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17182025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17192025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17202025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17212025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17222025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17232025-02-23T09:16:35.063ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
17242025-02-23T09:16:35.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17252025-02-23T09:16:35.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17262025-02-23T09:16:35.065ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17272025-02-23T09:16:35.065ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8379998a-953e-4e51-a6b4-768ec5c6a079", "content-length": "2", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
17282025-02-23T09:16:35.065ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17292025-02-23T09:16:35.065ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "01143d35-51f6-47c6-9807-9919acc12e75", "content-length": "52", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
17302025-02-23T09:16:35.065ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
17312025-02-23T09:16:35.065ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17322025-02-23T09:16:35.126ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "52158bf2-634f-44b8-968a-f416ede66d46", "content-length": "691", "date": "Sun, 23 Feb 2025 09:16:35 GMT"} })
17332025-02-23T09:16:35.126ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17342025-02-23T09:16:35.126ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17352025-02-23T09:16:35.126ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17362025-02-23T09:16:35.128ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 600.684439ms iteration = 17 status = {}
17372025-02-23T09:16:35.217ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "68dcd7d9-97ce-40cd-82a3-7fe0719e24bf", "date": "Sun, 23 Feb 2025 09:16:34 GMT"} })
17382025-02-23T09:16:35.217ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
17392025-02-23T09:16:35.217ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17402025-02-23T09:16:35.222ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "41ea84fa-5220-4090-b6c4-128ec98a9b63", "content-length": "682", "date": "Sun, 23 Feb 2025 09:16:35 GMT"} })
17412025-02-23T09:16:35.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17422025-02-23T09:16:35.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17432025-02-23T09:16:35.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17442025-02-23T09:16:35.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17452025-02-23T09:16:35.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17462025-02-23T09:16:35.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17472025-02-23T09:16:35.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17482025-02-23T09:16:35.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17492025-02-23T09:16:35.239ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.37613ms iteration = 17 status = {}
17502025-02-23T09:16:35.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7df029c2-5fb0-46b5-b1b4-a867d24a344a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17512025-02-23T09:16:35.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7df029c2-5fb0-46b5-b1b4-a867d24a344a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17522025-02-23T09:16:35.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7df029c2-5fb0-46b5-b1b4-a867d24a344a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17532025-02-23T09:16:36.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 89250600-cd20-4fed-8dbb-f79545a65de7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17542025-02-23T09:16:36.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 89250600-cd20-4fed-8dbb-f79545a65de7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17552025-02-23T09:16:36.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1980c147-8a61-4421-ab9d-85b81602cd9d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17562025-02-23T09:16:36.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1980c147-8a61-4421-ab9d-85b81602cd9d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17572025-02-23T09:16:36.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1980c147-8a61-4421-ab9d-85b81602cd9d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17582025-02-23T09:16:36.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 89250600-cd20-4fed-8dbb-f79545a65de7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17592025-02-23T09:16:37.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 560 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 38360c15-1aeb-48fa-bc69-9f5a12e8a200 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
17602025-02-23T09:16:37.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fcc5dd17-0877-47e0-9525-b7475c74b434 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17612025-02-23T09:16:37.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fcc5dd17-0877-47e0-9525-b7475c74b434 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17622025-02-23T09:16:37.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fcc5dd17-0877-47e0-9525-b7475c74b434 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17632025-02-23T09:16:38.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ade4eab-743b-4105-a866-4ceefa43271c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17642025-02-23T09:16:38.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ade4eab-743b-4105-a866-4ceefa43271c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17652025-02-23T09:16:38.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ade4eab-743b-4105-a866-4ceefa43271c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17662025-02-23T09:16:39.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84ee4ff2-4011-445e-bf3f-b9efeb010087 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17672025-02-23T09:16:39.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84ee4ff2-4011-445e-bf3f-b9efeb010087 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17682025-02-23T09:16:39.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84ee4ff2-4011-445e-bf3f-b9efeb010087 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17692025-02-23T09:16:40.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d03f4cad-e30b-478e-ba7d-6f79bfcd12d8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17702025-02-23T09:16:40.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d03f4cad-e30b-478e-ba7d-6f79bfcd12d8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17712025-02-23T09:16:40.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d03f4cad-e30b-478e-ba7d-6f79bfcd12d8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17722025-02-23T09:16:41.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7d818831-42b2-4996-a908-9ee18dcf4d78 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17732025-02-23T09:16:41.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7d818831-42b2-4996-a908-9ee18dcf4d78 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17742025-02-23T09:16:41.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7d818831-42b2-4996-a908-9ee18dcf4d78 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17752025-02-23T09:16:42.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3674d5fb-5045-41b4-a2ff-9fb975e04950 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17762025-02-23T09:16:42.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3674d5fb-5045-41b4-a2ff-9fb975e04950 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17772025-02-23T09:16:42.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3674d5fb-5045-41b4-a2ff-9fb975e04950 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17782025-02-23T09:16:43.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ef4f1180-5584-4051-983f-a65f06d50282 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17792025-02-23T09:16:43.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ef4f1180-5584-4051-983f-a65f06d50282 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17802025-02-23T09:16:43.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ef4f1180-5584-4051-983f-a65f06d50282 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17812025-02-23T09:16:44.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8886574f-110a-4715-a300-e9cf0dfe92e2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17822025-02-23T09:16:44.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8886574f-110a-4715-a300-e9cf0dfe92e2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17832025-02-23T09:16:44.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8886574f-110a-4715-a300-e9cf0dfe92e2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
17842025-02-23T09:16:44.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
17852025-02-23T09:16:44.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
17862025-02-23T09:16:44.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17872025-02-23T09:16:44.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17882025-02-23T09:16:44.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17892025-02-23T09:16:44.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17902025-02-23T09:16:44.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17912025-02-23T09:16:44.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17922025-02-23T09:16:44.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17932025-02-23T09:16:44.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17942025-02-23T09:16:44.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17952025-02-23T09:16:44.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17962025-02-23T09:16:44.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972025-02-23T09:16:44.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
17982025-02-23T09:16:44.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17992025-02-23T09:16:44.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18002025-02-23T09:16:44.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
18012025-02-23T09:16:44.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.742717ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
18022025-02-23T09:16:44.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18032025-02-23T09:16:44.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18042025-02-23T09:16:44.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.068237ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18052025-02-23T09:16:45.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b94d646-a65c-4716-aeab-a0c015f8115e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18062025-02-23T09:16:45.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b94d646-a65c-4716-aeab-a0c015f8115e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18072025-02-23T09:16:45.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b94d646-a65c-4716-aeab-a0c015f8115e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18082025-02-23T09:16:46.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0520fd41-111f-44fd-ad0e-0c8e553f46f9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18092025-02-23T09:16:46.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0520fd41-111f-44fd-ad0e-0c8e553f46f9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18102025-02-23T09:16:46.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0520fd41-111f-44fd-ad0e-0c8e553f46f9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18112025-02-23T09:16:47.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 609 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 9702ed00-0f89-4076-93d9-d5a32635145c response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
18122025-02-23T09:16:47.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 85353c88-c706-4c08-a881-ab683f88cde9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18132025-02-23T09:16:47.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 85353c88-c706-4c08-a881-ab683f88cde9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18142025-02-23T09:16:47.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 85353c88-c706-4c08-a881-ab683f88cde9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18152025-02-23T09:16:48.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2bd71e6c-6153-439f-853a-6c949be46b74 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18162025-02-23T09:16:48.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2bd71e6c-6153-439f-853a-6c949be46b74 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18172025-02-23T09:16:48.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2bd71e6c-6153-439f-853a-6c949be46b74 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18182025-02-23T09:16:49.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fc637f93-a2ba-4af2-b4b6-c34b0a94be71 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18192025-02-23T09:16:49.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fc637f93-a2ba-4af2-b4b6-c34b0a94be71 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18202025-02-23T09:16:49.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fc637f93-a2ba-4af2-b4b6-c34b0a94be71 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18212025-02-23T09:16:50.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7c9fde0-3423-4d04-b6bd-0a2c622f04d6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18222025-02-23T09:16:50.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7c9fde0-3423-4d04-b6bd-0a2c622f04d6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18232025-02-23T09:16:50.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7c9fde0-3423-4d04-b6bd-0a2c622f04d6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18242025-02-23T09:16:51.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e009954c-2dbb-4a19-a0b4-d9843aa7a84e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18252025-02-23T09:16:51.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e009954c-2dbb-4a19-a0b4-d9843aa7a84e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18262025-02-23T09:16:51.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e009954c-2dbb-4a19-a0b4-d9843aa7a84e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18272025-02-23T09:16:52.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a83077e3-e4ae-4475-8029-b51cf25298d0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18282025-02-23T09:16:52.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a83077e3-e4ae-4475-8029-b51cf25298d0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18292025-02-23T09:16:52.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a83077e3-e4ae-4475-8029-b51cf25298d0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18302025-02-23T09:16:53.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d15b2c68-4bca-41f4-b113-07478d45c48c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18312025-02-23T09:16:53.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d15b2c68-4bca-41f4-b113-07478d45c48c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18322025-02-23T09:16:53.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d15b2c68-4bca-41f4-b113-07478d45c48c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18332025-02-23T09:16:54.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
18342025-02-23T09:16:54.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
18352025-02-23T09:16:54.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18362025-02-23T09:16:54.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18372025-02-23T09:16:54.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18382025-02-23T09:16:54.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18392025-02-23T09:16:54.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18402025-02-23T09:16:54.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18412025-02-23T09:16:54.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18422025-02-23T09:16:54.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18432025-02-23T09:16:54.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18442025-02-23T09:16:54.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18452025-02-23T09:16:54.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18462025-02-23T09:16:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18472025-02-23T09:16:54.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18482025-02-23T09:16:54.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
18492025-02-23T09:16:54.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18502025-02-23T09:16:54.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18512025-02-23T09:16:54.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
18522025-02-23T09:16:54.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.819409ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
18532025-02-23T09:16:54.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.400529ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18542025-02-23T09:16:54.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7a287fea-7a7c-40df-b427-fa6d2761f138 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18552025-02-23T09:16:54.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7a287fea-7a7c-40df-b427-fa6d2761f138 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18562025-02-23T09:16:54.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7a287fea-7a7c-40df-b427-fa6d2761f138 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18572025-02-23T09:16:55.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 745da2dd-9692-4ffa-bc44-54dba8e13653 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18582025-02-23T09:16:55.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 745da2dd-9692-4ffa-bc44-54dba8e13653 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18592025-02-23T09:16:55.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 745da2dd-9692-4ffa-bc44-54dba8e13653 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18602025-02-23T09:16:56.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 34dc1b90-6264-4586-afdc-83401f047790 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18612025-02-23T09:16:56.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 34dc1b90-6264-4586-afdc-83401f047790 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18622025-02-23T09:16:56.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 34dc1b90-6264-4586-afdc-83401f047790 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18632025-02-23T09:16:57.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = a80674c4-a300-4d6b-aca5-c72ddcf7b401 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
18642025-02-23T09:16:57.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20faf687-d262-4943-86be-c59a8c398dac roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18652025-02-23T09:16:57.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20faf687-d262-4943-86be-c59a8c398dac resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18662025-02-23T09:16:57.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20faf687-d262-4943-86be-c59a8c398dac response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18672025-02-23T09:16:58.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b573315-7af0-43bf-bd9d-77cecc73110b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18682025-02-23T09:16:58.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b573315-7af0-43bf-bd9d-77cecc73110b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18692025-02-23T09:16:58.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b573315-7af0-43bf-bd9d-77cecc73110b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18702025-02-23T09:16:59.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4330b7e-1da0-4fd2-9178-c841d4e02058 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18712025-02-23T09:16:59.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4330b7e-1da0-4fd2-9178-c841d4e02058 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18722025-02-23T09:16:59.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4330b7e-1da0-4fd2-9178-c841d4e02058 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18732025-02-23T09:17:00.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a67f276-efbc-4279-b824-c980b42ba949 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18742025-02-23T09:17:00.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a67f276-efbc-4279-b824-c980b42ba949 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18752025-02-23T09:17:00.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a67f276-efbc-4279-b824-c980b42ba949 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18762025-02-23T09:17:01.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 61ec9b1b-9e5a-4e08-be21-f2abf8c57f35 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18772025-02-23T09:17:01.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 61ec9b1b-9e5a-4e08-be21-f2abf8c57f35 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18782025-02-23T09:17:01.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 61ec9b1b-9e5a-4e08-be21-f2abf8c57f35 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18792025-02-23T09:17:02.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = cb9955af-f0c6-4091-812f-f3ef0c0a38dd roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
18802025-02-23T09:17:02.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = cb9955af-f0c6-4091-812f-f3ef0c0a38dd resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
18812025-02-23T09:17:02.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = cb9955af-f0c6-4091-812f-f3ef0c0a38dd response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
18822025-02-23T09:17:02.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 15637246-c14f-435b-a7b7-9e16818c1a0c roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
18832025-02-23T09:17:02.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 15637246-c14f-435b-a7b7-9e16818c1a0c resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
18842025-02-23T09:17:02.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 15637246-c14f-435b-a7b7-9e16818c1a0c response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
18852025-02-23T09:17:02.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 044acec7-e06c-4dbd-bcb0-017481189cc3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18862025-02-23T09:17:02.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 044acec7-e06c-4dbd-bcb0-017481189cc3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18872025-02-23T09:17:02.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 044acec7-e06c-4dbd-bcb0-017481189cc3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18882025-02-23T09:17:03.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e8431f8-1eb0-4237-9432-069ee871db18 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18892025-02-23T09:17:03.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e8431f8-1eb0-4237-9432-069ee871db18 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18902025-02-23T09:17:03.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e8431f8-1eb0-4237-9432-069ee871db18 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18912025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
18922025-02-23T09:17:04.526ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18932025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
18942025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
18952025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18962025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18972025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18982025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
18992025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19002025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
19012025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19022025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
19032025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19042025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
19052025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19062025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
19072025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
19082025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19092025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19102025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
19112025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
19122025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
19132025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19142025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19152025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19162025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
19172025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19182025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
19192025-02-23T09:17:04.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19202025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19212025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19222025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19232025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19242025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19252025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19262025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19272025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19282025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19292025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19302025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19312025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19322025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19332025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
19342025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
19352025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
19362025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
19372025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19382025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19392025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
19402025-02-23T09:17:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19412025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
19422025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19432025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19442025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19452025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19462025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19472025-02-23T09:17:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
19482025-02-23T09:17:04.529ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36040, tv_nsec: 229840648 } })
19492025-02-23T09:17:04.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19502025-02-23T09:17:04.530ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
19512025-02-23T09:17:04.530ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36040, tv_nsec: 230376238 } })
19522025-02-23T09:17:04.530ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
19532025-02-23T09:17:04.530ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.824081ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19542025-02-23T09:17:04.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19552025-02-23T09:17:04.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19562025-02-23T09:17:04.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19572025-02-23T09:17:04.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19582025-02-23T09:17:04.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592025-02-23T09:17:04.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19602025-02-23T09:17:04.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19612025-02-23T09:17:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19622025-02-23T09:17:04.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19632025-02-23T09:17:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19642025-02-23T09:17:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19652025-02-23T09:17:04.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19662025-02-23T09:17:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19672025-02-23T09:17:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19682025-02-23T09:17:04.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19692025-02-23T09:17:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19702025-02-23T09:17:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19712025-02-23T09:17:04.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19722025-02-23T09:17:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19732025-02-23T09:17:04.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19742025-02-23T09:17:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19752025-02-23T09:17:04.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19762025-02-23T09:17:04.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19772025-02-23T09:17:04.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19782025-02-23T09:17:04.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19792025-02-23T09:17:04.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19802025-02-23T09:17:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19812025-02-23T09:17:04.584ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19822025-02-23T09:17:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19832025-02-23T09:17:04.587ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19842025-02-23T09:17:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19852025-02-23T09:17:04.592ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
19862025-02-23T09:17:04.592ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19872025-02-23T09:17:04.593ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
19882025-02-23T09:17:04.593ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19892025-02-23T09:17:04.593ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "126e9868-51b2-41a8-98e3-a1d874f54db9", "content-length": "26", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
19902025-02-23T09:17:04.593ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19912025-02-23T09:17:04.593ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27486d57-b8c5-4f1d-bfc4-d525d6e88074", "content-length": "26", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
19922025-02-23T09:17:04.593ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19932025-02-23T09:17:04.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19942025-02-23T09:17:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19952025-02-23T09:17:04.595ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19962025-02-23T09:17:04.595ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19972025-02-23T09:17:04.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19982025-02-23T09:17:04.595ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19992025-02-23T09:17:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20002025-02-23T09:17:04.595ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20012025-02-23T09:17:04.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20022025-02-23T09:17:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.440747ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
20032025-02-23T09:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20042025-02-23T09:17:04.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20052025-02-23T09:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20062025-02-23T09:17:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20072025-02-23T09:17:04.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082025-02-23T09:17:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20092025-02-23T09:17:04.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20102025-02-23T09:17:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20112025-02-23T09:17:04.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122025-02-23T09:17:04.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20132025-02-23T09:17:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20142025-02-23T09:17:04.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20152025-02-23T09:17:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20162025-02-23T09:17:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20172025-02-23T09:17:04.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20182025-02-23T09:17:04.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20192025-02-23T09:17:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20202025-02-23T09:17:04.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.480881ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
20212025-02-23T09:17:04.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20222025-02-23T09:17:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20232025-02-23T09:17:04.614ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 86.58191ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
20242025-02-23T09:17:04.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36040, tv_nsec: 314894430 } })
20252025-02-23T09:17:04.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
20262025-02-23T09:17:04.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20272025-02-23T09:17:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20282025-02-23T09:17:04.618ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20292025-02-23T09:17:04.618ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.458062ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20302025-02-23T09:17:04.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.746968ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20312025-02-23T09:17:04.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322025-02-23T09:17:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
20332025-02-23T09:17:04.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20342025-02-23T09:17:04.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20352025-02-23T09:17:04.645ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20362025-02-23T09:17:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20372025-02-23T09:17:04.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.996529ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20382025-02-23T09:17:04.653ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20392025-02-23T09:17:04.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20402025-02-23T09:17:04.655ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20412025-02-23T09:17:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20422025-02-23T09:17:04.656ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20432025-02-23T09:17:04.656ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20442025-02-23T09:17:04.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20452025-02-23T09:17:04.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.099574ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20462025-02-23T09:17:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20472025-02-23T09:17:04.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20482025-02-23T09:17:04.658ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
20492025-02-23T09:17:04.658ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.320937ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20502025-02-23T09:17:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20512025-02-23T09:17:04.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.139222ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20522025-02-23T09:17:04.661ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
20532025-02-23T09:17:04.661ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.841843ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
20542025-02-23T09:17:04.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552025-02-23T09:17:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
20562025-02-23T09:17:04.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20572025-02-23T09:17:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20582025-02-23T09:17:04.677ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 150.72477ms iteration = 18 status = 0
20592025-02-23T09:17:04.688ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20602025-02-23T09:17:04.688ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "70553cee-7a55-4d91-a6f8-fe3fc4e1cbf7", "content-length": "2", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
20612025-02-23T09:17:04.690ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20622025-02-23T09:17:04.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20632025-02-23T09:17:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 165.331473ms iteration = 18 status = null
20642025-02-23T09:17:04.697ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 170.525761ms iteration = 18 status = {}
20652025-02-23T09:17:04.697ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20662025-02-23T09:17:04.697ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20672025-02-23T09:17:04.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.498501ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20682025-02-23T09:17:04.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
20692025-02-23T09:17:04.714ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20702025-02-23T09:17:04.715ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "facd171b-813a-4fc8-9a8c-cff2f15334a0", "content-length": "26", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
20712025-02-23T09:17:04.715ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20722025-02-23T09:17:04.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
20732025-02-23T09:17:04.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20742025-02-23T09:17:04.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20752025-02-23T09:17:04.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762025-02-23T09:17:04.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20772025-02-23T09:17:04.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20782025-02-23T09:17:04.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20792025-02-23T09:17:04.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802025-02-23T09:17:04.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20812025-02-23T09:17:04.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20822025-02-23T09:17:04.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20832025-02-23T09:17:04.750ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 223.386621ms iteration = 20 status = {"physical_disks_added":0}
20842025-02-23T09:17:04.754ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20852025-02-23T09:17:04.754ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20862025-02-23T09:17:04.754ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "391f29b1-7aa9-444a-9285-535798a176c7", "content-length": "372", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
20872025-02-23T09:17:04.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20882025-02-23T09:17:04.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20892025-02-23T09:17:04.804ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20902025-02-23T09:17:04.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20912025-02-23T09:17:04.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20922025-02-23T09:17:04.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20932025-02-23T09:17:04.839ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
20942025-02-23T09:17:04.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20952025-02-23T09:17:04.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20962025-02-23T09:17:04.849ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20972025-02-23T09:17:04.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20982025-02-23T09:17:04.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd08c396-ca52-452a-9aa6-1dfc29c2877a", "content-length": "134", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
20992025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21002025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
21012025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21022025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21032025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21042025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21052025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21062025-02-23T09:17:04.859ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21072025-02-23T09:17:04.860ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21082025-02-23T09:17:04.860ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21092025-02-23T09:17:04.860ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
21102025-02-23T09:17:04.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21112025-02-23T09:17:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21122025-02-23T09:17:04.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21132025-02-23T09:17:04.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1270b71-39b6-47b9-9022-ad87d24f8917", "content-length": "2", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21142025-02-23T09:17:04.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21152025-02-23T09:17:04.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "34230247-ffa9-4db5-b0b3-8c0f36209a10", "content-length": "52", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21162025-02-23T09:17:04.862ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
21172025-02-23T09:17:04.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21182025-02-23T09:17:04.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "21df0808-22f7-488b-9b4a-eafc42f7d367", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21192025-02-23T09:17:04.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21202025-02-23T09:17:04.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21212025-02-23T09:17:04.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0910aaa2-c3a4-4192-ae13-2094b92bc920", "content-length": "691", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21222025-02-23T09:17:04.887ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21232025-02-23T09:17:04.887ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21242025-02-23T09:17:04.887ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21252025-02-23T09:17:04.888ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 361.998404ms iteration = 18 status = {}
21262025-02-23T09:17:04.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21272025-02-23T09:17:04.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21282025-02-23T09:17:04.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21292025-02-23T09:17:04.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21302025-02-23T09:17:04.897ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21312025-02-23T09:17:04.897ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21322025-02-23T09:17:04.897ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8dbb8d3e-851b-457f-9ad9-cc78c9c38b85", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21332025-02-23T09:17:04.899ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.546871ms iteration = 18 status = {}
21342025-02-23T09:17:04.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 240f08e2-880f-4eaa-a544-f52126b455ac roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21352025-02-23T09:17:04.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 240f08e2-880f-4eaa-a544-f52126b455ac resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21362025-02-23T09:17:04.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 240f08e2-880f-4eaa-a544-f52126b455ac response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21372025-02-23T09:17:04.980ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "078abb47-5cb7-4c45-8c97-11a0d0cc4e36", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21382025-02-23T09:17:04.980ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
21392025-02-23T09:17:04.980ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21402025-02-23T09:17:04.984ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "420d9319-8575-49f3-bc04-c7908eca7b87", "content-length": "682", "date": "Sun, 23 Feb 2025 09:17:04 GMT"} })
21412025-02-23T09:17:04.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21422025-02-23T09:17:04.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21432025-02-23T09:17:04.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21442025-02-23T09:17:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21452025-02-23T09:17:04.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21462025-02-23T09:17:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21472025-02-23T09:17:04.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21482025-02-23T09:17:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21492025-02-23T09:17:05.001ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 474.338526ms iteration = 18 status = {}
21502025-02-23T09:17:05.297ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21512025-02-23T09:17:05.297ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
21522025-02-23T09:17:05.329ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
21532025-02-23T09:17:05.329ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39128
21542025-02-23T09:17:05.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39128 req_id = f3a70c10-16a1-4dfc-aa97-0d240f716086 roles = RoleSet { roles: {} } uri = /metrics/producers
21552025-02-23T09:17:05.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39128 req_id = f3a70c10-16a1-4dfc-aa97-0d240f716086 resource = Database result = Ok(()) uri = /metrics/producers
21562025-02-23T09:17:05.371ZINFOnexus: assigned collector to new producer collector_id = de6ca227-55b1-420b-b454-b4242aff85c9 file = nexus/src/app/oximeter.rs:76 producer_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
21572025-02-23T09:17:05.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 41806 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39128 req_id = f3a70c10-16a1-4dfc-aa97-0d240f716086 response_code = 201 uri = /metrics/producers
21582025-02-23T09:17:05.371ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f3a70c10-16a1-4dfc-aa97-0d240f716086", "content-length": "41", "date": "Sun, 23 Feb 2025 09:17:05 GMT"} })
21592025-02-23T09:17:05.373ZDEBGnexus (producer-registration-task): registered with nexus successfully
21602025-02-23T09:17:05.373ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21612025-02-23T09:17:05.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 64200e8e-029e-457d-b888-2e8bc5d249e2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21622025-02-23T09:17:05.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 64200e8e-029e-457d-b888-2e8bc5d249e2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21632025-02-23T09:17:05.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 64200e8e-029e-457d-b888-2e8bc5d249e2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21642025-02-23T09:17:06.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 1ddfb100-c8dd-4f2d-ad1f-6dd31a0cf41b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
21652025-02-23T09:17:06.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 1ddfb100-c8dd-4f2d-ad1f-6dd31a0cf41b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
21662025-02-23T09:17:06.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 1ddfb100-c8dd-4f2d-ad1f-6dd31a0cf41b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
21672025-02-23T09:17:06.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 21e49ef9-ad6a-4162-af5c-53e919254aa6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21682025-02-23T09:17:06.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 21e49ef9-ad6a-4162-af5c-53e919254aa6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21692025-02-23T09:17:06.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 21e49ef9-ad6a-4162-af5c-53e919254aa6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21702025-02-23T09:17:07.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 5e1b3be9-d1dd-4bcb-b20d-abf3b29e3207 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
21712025-02-23T09:17:07.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 63cdd1c0-0ff5-4f6f-a347-ef9a4853d19d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21722025-02-23T09:17:07.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 63cdd1c0-0ff5-4f6f-a347-ef9a4853d19d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21732025-02-23T09:17:07.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 63cdd1c0-0ff5-4f6f-a347-ef9a4853d19d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21742025-02-23T09:17:08.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8727a304-28bb-4f87-8d3b-5126bad58877 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21752025-02-23T09:17:08.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8727a304-28bb-4f87-8d3b-5126bad58877 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21762025-02-23T09:17:08.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8727a304-28bb-4f87-8d3b-5126bad58877 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21772025-02-23T09:17:10.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = be11aaf3-403a-4cc0-8dbd-bff86750adc3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21782025-02-23T09:17:10.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = be11aaf3-403a-4cc0-8dbd-bff86750adc3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21792025-02-23T09:17:10.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = be11aaf3-403a-4cc0-8dbd-bff86750adc3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21802025-02-23T09:17:11.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7f7ec05c-5f3d-4bcd-b81c-d157134577dc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21812025-02-23T09:17:11.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7f7ec05c-5f3d-4bcd-b81c-d157134577dc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21822025-02-23T09:17:11.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7f7ec05c-5f3d-4bcd-b81c-d157134577dc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21832025-02-23T09:17:12.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d18d948a-bfed-4dcc-b680-5fab26d642f9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21842025-02-23T09:17:12.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d18d948a-bfed-4dcc-b680-5fab26d642f9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21852025-02-23T09:17:12.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d18d948a-bfed-4dcc-b680-5fab26d642f9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21862025-02-23T09:17:13.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e04f6934-ee44-4fe6-8149-aa404726dae3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21872025-02-23T09:17:13.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e04f6934-ee44-4fe6-8149-aa404726dae3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21882025-02-23T09:17:13.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e04f6934-ee44-4fe6-8149-aa404726dae3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21892025-02-23T09:17:14.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e2cf04b-9490-434b-8b64-cd615b86c5c8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21902025-02-23T09:17:14.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e2cf04b-9490-434b-8b64-cd615b86c5c8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21912025-02-23T09:17:14.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e2cf04b-9490-434b-8b64-cd615b86c5c8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21922025-02-23T09:17:14.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
21932025-02-23T09:17:14.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21942025-02-23T09:17:14.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
21952025-02-23T09:17:14.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21962025-02-23T09:17:14.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21972025-02-23T09:17:14.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21982025-02-23T09:17:14.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21992025-02-23T09:17:14.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22002025-02-23T09:17:14.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22012025-02-23T09:17:14.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.235259ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22022025-02-23T09:17:14.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22032025-02-23T09:17:14.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22042025-02-23T09:17:14.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22052025-02-23T09:17:14.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22062025-02-23T09:17:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22072025-02-23T09:17:14.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082025-02-23T09:17:14.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
22092025-02-23T09:17:14.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22102025-02-23T09:17:14.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22112025-02-23T09:17:14.547ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
22122025-02-23T09:17:14.547ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.669447ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
22132025-02-23T09:17:15.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80602d62-3235-4aa8-9780-be461f30403c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22142025-02-23T09:17:15.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80602d62-3235-4aa8-9780-be461f30403c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22152025-02-23T09:17:15.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80602d62-3235-4aa8-9780-be461f30403c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22162025-02-23T09:17:16.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 95258fb4-05fc-44fd-9f11-3a1ba23f1342 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22172025-02-23T09:17:16.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 95258fb4-05fc-44fd-9f11-3a1ba23f1342 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22182025-02-23T09:17:16.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 95258fb4-05fc-44fd-9f11-3a1ba23f1342 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22192025-02-23T09:17:17.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6df6b9d2-cb11-4869-8490-044ecba96089 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22202025-02-23T09:17:17.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6df6b9d2-cb11-4869-8490-044ecba96089 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22212025-02-23T09:17:17.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6df6b9d2-cb11-4869-8490-044ecba96089 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22222025-02-23T09:17:17.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 6092e54c-b143-4635-9e81-13a47a15dfeb response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
22232025-02-23T09:17:18.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e95f36b-1b6a-4d6c-89ba-c49b4be1f5c3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22242025-02-23T09:17:18.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e95f36b-1b6a-4d6c-89ba-c49b4be1f5c3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22252025-02-23T09:17:18.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e95f36b-1b6a-4d6c-89ba-c49b4be1f5c3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22262025-02-23T09:17:19.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 29a6c46f-a0a4-426f-93b0-733bdb134664 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22272025-02-23T09:17:19.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 29a6c46f-a0a4-426f-93b0-733bdb134664 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22282025-02-23T09:17:19.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 29a6c46f-a0a4-426f-93b0-733bdb134664 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22292025-02-23T09:17:20.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 790aa0e9-db87-41be-b556-0ad7e0ae8f9c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22302025-02-23T09:17:20.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 790aa0e9-db87-41be-b556-0ad7e0ae8f9c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22312025-02-23T09:17:20.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 790aa0e9-db87-41be-b556-0ad7e0ae8f9c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22322025-02-23T09:17:21.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 407dd492-3877-4b0e-a497-2a0831d7a188 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22332025-02-23T09:17:21.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 407dd492-3877-4b0e-a497-2a0831d7a188 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22342025-02-23T09:17:21.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 407dd492-3877-4b0e-a497-2a0831d7a188 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22352025-02-23T09:17:22.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 417d5285-4258-4f05-becc-0fa4b10a8874 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22362025-02-23T09:17:22.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 417d5285-4258-4f05-becc-0fa4b10a8874 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22372025-02-23T09:17:22.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 417d5285-4258-4f05-becc-0fa4b10a8874 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22382025-02-23T09:17:23.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d4051a4e-f3b1-40b0-8972-bbae901e3b38 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22392025-02-23T09:17:23.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d4051a4e-f3b1-40b0-8972-bbae901e3b38 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22402025-02-23T09:17:23.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d4051a4e-f3b1-40b0-8972-bbae901e3b38 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22412025-02-23T09:17:24.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 90aab434-5f2f-4f13-b011-9c9b93da2b08 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22422025-02-23T09:17:24.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 90aab434-5f2f-4f13-b011-9c9b93da2b08 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22432025-02-23T09:17:24.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 90aab434-5f2f-4f13-b011-9c9b93da2b08 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22442025-02-23T09:17:24.526ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
22452025-02-23T09:17:24.526ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
22462025-02-23T09:17:24.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22472025-02-23T09:17:24.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22482025-02-23T09:17:24.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22492025-02-23T09:17:24.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22502025-02-23T09:17:24.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22512025-02-23T09:17:24.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22522025-02-23T09:17:24.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22532025-02-23T09:17:24.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.610727ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22542025-02-23T09:17:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22552025-02-23T09:17:24.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22562025-02-23T09:17:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22572025-02-23T09:17:24.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22582025-02-23T09:17:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22592025-02-23T09:17:24.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602025-02-23T09:17:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
22612025-02-23T09:17:24.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22622025-02-23T09:17:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22632025-02-23T09:17:24.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
22642025-02-23T09:17:24.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.313001ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
22652025-02-23T09:17:25.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7cc3653-c34d-4a0e-ae2f-ff4900dbe1e6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22662025-02-23T09:17:25.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7cc3653-c34d-4a0e-ae2f-ff4900dbe1e6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22672025-02-23T09:17:25.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7cc3653-c34d-4a0e-ae2f-ff4900dbe1e6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22682025-02-23T09:17:26.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = df477b12-883e-4336-8999-45abbb881bca roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22692025-02-23T09:17:26.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = df477b12-883e-4336-8999-45abbb881bca resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22702025-02-23T09:17:26.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = df477b12-883e-4336-8999-45abbb881bca response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22712025-02-23T09:17:27.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = ec11344e-8dbb-4e95-9edf-7c4f676ef1a0 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
22722025-02-23T09:17:27.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa726113-0f07-4508-97e0-209a6b28ddff roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22732025-02-23T09:17:27.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa726113-0f07-4508-97e0-209a6b28ddff resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22742025-02-23T09:17:27.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa726113-0f07-4508-97e0-209a6b28ddff response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22752025-02-23T09:17:28.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d881e051-9ec6-4a2e-be50-7041b415d189 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22762025-02-23T09:17:28.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d881e051-9ec6-4a2e-be50-7041b415d189 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22772025-02-23T09:17:28.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d881e051-9ec6-4a2e-be50-7041b415d189 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22782025-02-23T09:17:29.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f82e481c-5067-4e0b-a4f7-e0ccd6b8b54d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22792025-02-23T09:17:29.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f82e481c-5067-4e0b-a4f7-e0ccd6b8b54d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22802025-02-23T09:17:29.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f82e481c-5067-4e0b-a4f7-e0ccd6b8b54d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22812025-02-23T09:17:30.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 92d624cc-a483-4cfc-bd4d-e535a435f397 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22822025-02-23T09:17:30.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 92d624cc-a483-4cfc-bd4d-e535a435f397 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22832025-02-23T09:17:30.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 92d624cc-a483-4cfc-bd4d-e535a435f397 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22842025-02-23T09:17:31.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8fbf28cc-d950-47c5-a9ec-f9176e6d5752 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22852025-02-23T09:17:31.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8fbf28cc-d950-47c5-a9ec-f9176e6d5752 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22862025-02-23T09:17:31.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8fbf28cc-d950-47c5-a9ec-f9176e6d5752 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22872025-02-23T09:17:32.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 16c37fb4-6447-4c22-bdb6-918b250bc6bc roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
22882025-02-23T09:17:32.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 16c37fb4-6447-4c22-bdb6-918b250bc6bc resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
22892025-02-23T09:17:32.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 16c37fb4-6447-4c22-bdb6-918b250bc6bc response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
22902025-02-23T09:17:32.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 02b8ca95-7724-426e-b2d3-9b4b48b87634 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
22912025-02-23T09:17:32.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 02b8ca95-7724-426e-b2d3-9b4b48b87634 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
22922025-02-23T09:17:32.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 02b8ca95-7724-426e-b2d3-9b4b48b87634 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
22932025-02-23T09:17:32.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5f0d287e-bbba-4316-b94d-52ca846836ad roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22942025-02-23T09:17:32.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5f0d287e-bbba-4316-b94d-52ca846836ad resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22952025-02-23T09:17:32.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5f0d287e-bbba-4316-b94d-52ca846836ad response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22962025-02-23T09:17:33.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d7d590f4-c43d-420f-8809-f825bf4143cd roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22972025-02-23T09:17:33.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d7d590f4-c43d-420f-8809-f825bf4143cd resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22982025-02-23T09:17:33.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d7d590f4-c43d-420f-8809-f825bf4143cd response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22992025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
23002025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
23012025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23022025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23032025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
23042025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23052025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
23062025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23072025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23082025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
23092025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
23102025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23112025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
23122025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
23132025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23142025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
23152025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23162025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23172025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
23182025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23192025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
23202025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23212025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
23222025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23232025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
23242025-02-23T09:17:34.527ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23252025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23262025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
23272025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23282025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
23292025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
23302025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23312025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
23322025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23332025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
23342025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23352025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23362025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
23372025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23382025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
23392025-02-23T09:17:34.527ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:07:34.527546340 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23402025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23412025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
23422025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
23432025-02-23T09:17:34.527ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23442025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
23452025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23462025-02-23T09:17:34.527ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
23472025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.26\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
23482025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
23492025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
23502025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23512025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
23522025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23532025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
23542025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
23552025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
23562025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23572025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
23582025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23592025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
23602025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
23612025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23622025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23632025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
23642025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23652025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
23662025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23672025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23682025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23692025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23702025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23712025-02-23T09:17:34.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23722025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23732025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23742025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23752025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23762025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23772025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23782025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23792025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23802025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23812025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23822025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23832025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23842025-02-23T09:17:34.528ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 36070, tv_nsec: 228080799 } })
23852025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23862025-02-23T09:17:34.528ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 36070, tv_nsec: 228134060 } })
23872025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23882025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23892025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23902025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
23912025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23922025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23932025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23942025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23952025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23962025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23972025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23982025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23992025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24002025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24012025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24022025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24032025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24042025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
24052025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.230553ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24062025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.482558ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
24072025-02-23T09:17:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24082025-02-23T09:17:34.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24092025-02-23T09:17:34.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24102025-02-23T09:17:34.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112025-02-23T09:17:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24122025-02-23T09:17:34.536ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24132025-02-23T09:17:34.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24142025-02-23T09:17:34.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5ecf7337-0789-4306-86e3-d7b8819c7d76 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
24152025-02-23T09:17:34.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5ecf7337-0789-4306-86e3-d7b8819c7d76 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
24162025-02-23T09:17:34.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.787021ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24172025-02-23T09:17:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24182025-02-23T09:17:34.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24192025-02-23T09:17:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24202025-02-23T09:17:34.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24212025-02-23T09:17:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24222025-02-23T09:17:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24232025-02-23T09:17:34.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24242025-02-23T09:17:34.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24252025-02-23T09:17:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24262025-02-23T09:17:34.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24272025-02-23T09:17:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24282025-02-23T09:17:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24292025-02-23T09:17:34.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24302025-02-23T09:17:34.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24312025-02-23T09:17:34.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24322025-02-23T09:17:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24332025-02-23T09:17:34.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24342025-02-23T09:17:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24352025-02-23T09:17:34.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24362025-02-23T09:17:34.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24372025-02-23T09:17:34.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24382025-02-23T09:17:34.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392025-02-23T09:17:34.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402025-02-23T09:17:34.556ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24412025-02-23T09:17:34.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24422025-02-23T09:17:34.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24432025-02-23T09:17:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24442025-02-23T09:17:34.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24452025-02-23T09:17:34.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36070, tv_nsec: 260303042 } })
24462025-02-23T09:17:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24472025-02-23T09:17:34.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24482025-02-23T09:17:34.560ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
24492025-02-23T09:17:34.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24502025-02-23T09:17:34.561ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24512025-02-23T09:17:34.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24522025-02-23T09:17:34.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24532025-02-23T09:17:34.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24542025-02-23T09:17:34.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24552025-02-23T09:17:34.563ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:07:34.527546340 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24562025-02-23T09:17:34.563ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 36.008144ms iteration = 10 status = {"expiration":"2025-02-23T09:07:34.527546340Z","pruned":[]}
24572025-02-23T09:17:34.565ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24582025-02-23T09:17:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24592025-02-23T09:17:34.568ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24602025-02-23T09:17:34.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24612025-02-23T09:17:34.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36070, tv_nsec: 269385412 } })
24622025-02-23T09:17:34.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.405862ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
24632025-02-23T09:17:34.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
24642025-02-23T09:17:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 53.097883ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
24652025-02-23T09:17:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 53.260746ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
24662025-02-23T09:17:34.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5ecf7337-0789-4306-86e3-d7b8819c7d76 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
24672025-02-23T09:17:34.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24682025-02-23T09:17:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24692025-02-23T09:17:34.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36070, tv_nsec: 313369605 } })
24702025-02-23T09:17:34.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
24712025-02-23T09:17:34.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24722025-02-23T09:17:34.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24732025-02-23T09:17:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24742025-02-23T09:17:34.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752025-02-23T09:17:34.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24762025-02-23T09:17:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24772025-02-23T09:17:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24782025-02-23T09:17:34.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24792025-02-23T09:17:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24802025-02-23T09:17:34.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812025-02-23T09:17:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24822025-02-23T09:17:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24832025-02-23T09:17:34.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24842025-02-23T09:17:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24852025-02-23T09:17:34.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24862025-02-23T09:17:34.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24872025-02-23T09:17:34.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24882025-02-23T09:17:34.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24892025-02-23T09:17:34.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24902025-02-23T09:17:34.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24912025-02-23T09:17:34.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24922025-02-23T09:17:34.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24932025-02-23T09:17:34.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24942025-02-23T09:17:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
24952025-02-23T09:17:34.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24962025-02-23T09:17:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24972025-02-23T09:17:34.653ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24982025-02-23T09:17:34.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992025-02-23T09:17:34.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25002025-02-23T09:17:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25012025-02-23T09:17:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25022025-02-23T09:17:34.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25032025-02-23T09:17:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25042025-02-23T09:17:34.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 135.227661ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
25052025-02-23T09:17:34.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25062025-02-23T09:17:34.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25072025-02-23T09:17:34.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25082025-02-23T09:17:34.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 136.623956ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25092025-02-23T09:17:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25102025-02-23T09:17:34.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25112025-02-23T09:17:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25122025-02-23T09:17:34.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25132025-02-23T09:17:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25142025-02-23T09:17:34.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25152025-02-23T09:17:34.680ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25162025-02-23T09:17:34.680ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25172025-02-23T09:17:34.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25182025-02-23T09:17:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25192025-02-23T09:17:34.683ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25202025-02-23T09:17:34.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25212025-02-23T09:17:34.687ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25222025-02-23T09:17:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25232025-02-23T09:17:34.697ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25242025-02-23T09:17:34.698ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25252025-02-23T09:17:34.698ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25262025-02-23T09:17:34.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25272025-02-23T09:17:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25282025-02-23T09:17:34.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 172.537308ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25292025-02-23T09:17:34.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25302025-02-23T09:17:34.704ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25312025-02-23T09:17:34.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25322025-02-23T09:17:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25332025-02-23T09:17:34.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25342025-02-23T09:17:34.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25352025-02-23T09:17:34.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
25362025-02-23T09:17:34.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 180.425886ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
25372025-02-23T09:17:34.709ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25382025-02-23T09:17:34.709ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 182.213399ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25392025-02-23T09:17:34.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25402025-02-23T09:17:34.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25412025-02-23T09:17:34.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25422025-02-23T09:17:34.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25432025-02-23T09:17:34.738ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25442025-02-23T09:17:34.738ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25452025-02-23T09:17:34.738ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 210.877546ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25462025-02-23T09:17:34.757ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25472025-02-23T09:17:34.757ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25482025-02-23T09:17:34.757ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25492025-02-23T09:17:34.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25502025-02-23T09:17:34.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25512025-02-23T09:17:34.758ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
25522025-02-23T09:17:34.758ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25532025-02-23T09:17:34.758ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c2ddea8-4a61-46cf-88bd-456c6d8bde71", "content-length": "26", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
25542025-02-23T09:17:34.758ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25552025-02-23T09:17:34.759ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
25562025-02-23T09:17:34.794ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
25572025-02-23T09:17:34.795ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25582025-02-23T09:17:34.795ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d793e360-39d9-46b9-ae67-61bd17458a95", "content-length": "26", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
25592025-02-23T09:17:34.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25602025-02-23T09:17:34.796ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25612025-02-23T09:17:34.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
25622025-02-23T09:17:34.802ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25632025-02-23T09:17:34.802ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b371dbd6-31a0-4bdb-b140-ac0873915407", "content-length": "26", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
25642025-02-23T09:17:34.802ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25652025-02-23T09:17:34.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25662025-02-23T09:17:34.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25672025-02-23T09:17:34.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25682025-02-23T09:17:34.837ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25692025-02-23T09:17:34.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25702025-02-23T09:17:34.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "407a5f58-f63e-463e-bf06-b28417413b04", "content-length": "372", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
25712025-02-23T09:17:34.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25722025-02-23T09:17:34.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25732025-02-23T09:17:34.840ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 313.518437ms iteration = 5 status = {"nsuccess":5}
25742025-02-23T09:17:34.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25752025-02-23T09:17:34.843ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25762025-02-23T09:17:34.843ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25772025-02-23T09:17:34.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25782025-02-23T09:17:34.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25792025-02-23T09:17:34.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25802025-02-23T09:17:34.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25812025-02-23T09:17:34.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25822025-02-23T09:17:34.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 319.906266ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25832025-02-23T09:17:34.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842025-02-23T09:17:34.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25852025-02-23T09:17:34.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25862025-02-23T09:17:34.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d5dd3fe5-b3a2-4c74-9688-66d11fdef1d9", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25872025-02-23T09:17:34.850ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25882025-02-23T09:17:34.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25892025-02-23T09:17:34.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25902025-02-23T09:17:34.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25912025-02-23T09:17:34.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922025-02-23T09:17:34.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f71a40bd-8fe6-4165-b617-564fd76d51cd", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25932025-02-23T09:17:34.852ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25942025-02-23T09:17:34.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25952025-02-23T09:17:34.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25962025-02-23T09:17:34.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25972025-02-23T09:17:34.854ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25982025-02-23T09:17:34.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 326.611481ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25992025-02-23T09:17:34.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26002025-02-23T09:17:34.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26012025-02-23T09:17:34.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26022025-02-23T09:17:34.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26032025-02-23T09:17:34.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26042025-02-23T09:17:34.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26052025-02-23T09:17:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26062025-02-23T09:17:34.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26072025-02-23T09:17:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26082025-02-23T09:17:34.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26092025-02-23T09:17:34.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26102025-02-23T09:17:34.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26112025-02-23T09:17:34.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26122025-02-23T09:17:34.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26132025-02-23T09:17:34.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
26142025-02-23T09:17:34.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26152025-02-23T09:17:34.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26162025-02-23T09:17:34.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 344.15204ms iteration = 19 status = 0
26172025-02-23T09:17:34.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26182025-02-23T09:17:34.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26192025-02-23T09:17:34.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26202025-02-23T09:17:34.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26212025-02-23T09:17:34.896ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26222025-02-23T09:17:34.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 377.766979ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26232025-02-23T09:17:34.906ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
26242025-02-23T09:17:34.906ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 378.702776ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26252025-02-23T09:17:34.908ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26262025-02-23T09:17:34.908ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
26272025-02-23T09:17:34.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26282025-02-23T09:17:34.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26292025-02-23T09:17:34.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302025-02-23T09:17:34.913ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26312025-02-23T09:17:34.913ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26322025-02-23T09:17:34.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26332025-02-23T09:17:34.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26342025-02-23T09:17:34.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26352025-02-23T09:17:34.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26362025-02-23T09:17:34.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26372025-02-23T09:17:34.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26382025-02-23T09:17:34.918ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
26392025-02-23T09:17:34.918ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26402025-02-23T09:17:34.918ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
26412025-02-23T09:17:34.918ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 391.066798ms iteration = 10 status = {"generation":2}
26422025-02-23T09:17:34.919ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26432025-02-23T09:17:34.919ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26442025-02-23T09:17:34.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 392.358892ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26452025-02-23T09:17:34.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26462025-02-23T09:17:34.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26472025-02-23T09:17:34.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26482025-02-23T09:17:34.924ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26492025-02-23T09:17:34.924ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26502025-02-23T09:17:34.924ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
26512025-02-23T09:17:34.924ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 397.284914ms iteration = 10 status = {"generation":1}
26522025-02-23T09:17:34.928ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26532025-02-23T09:17:34.928ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26542025-02-23T09:17:34.928ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fd58b390-6ab9-4c32-a84b-a223c631b35c", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
26552025-02-23T09:17:34.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26562025-02-23T09:17:34.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26572025-02-23T09:17:34.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26582025-02-23T09:17:34.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26592025-02-23T09:17:34.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26602025-02-23T09:17:34.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26612025-02-23T09:17:34.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26622025-02-23T09:17:34.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26632025-02-23T09:17:34.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 406.415575ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26642025-02-23T09:17:34.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26652025-02-23T09:17:34.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26662025-02-23T09:17:34.938ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26672025-02-23T09:17:34.938ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26682025-02-23T09:17:34.939ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8cd58b2f-066e-46e0-bde3-345453f399d7", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
26692025-02-23T09:17:34.941ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 413.570338ms iteration = 19 status = {}
26702025-02-23T09:17:34.941ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26712025-02-23T09:17:34.941ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 414.357284ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26722025-02-23T09:17:34.974ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) }
26732025-02-23T09:17:34.974ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 447.164618ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26742025-02-23T09:17:34.988ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26752025-02-23T09:17:34.988ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae7f8e3-0c94-445c-99fb-2f33255d63df", "content-length": "2", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
26762025-02-23T09:17:34.989ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26772025-02-23T09:17:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26782025-02-23T09:17:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 464.282388ms iteration = 21 status = {"physical_disks_added":0}
26792025-02-23T09:17:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.574303ms iteration = 19 status = null
26802025-02-23T09:17:35.052ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 524.739479ms iteration = 19 status = {}
26812025-02-23T09:17:35.094ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26822025-02-23T09:17:35.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "04332b88-cad9-4e0c-ac40-a165c3903dcf", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26832025-02-23T09:17:35.095ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26842025-02-23T09:17:35.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "221587ca-a84f-4047-90f8-c89354e68f3a", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26852025-02-23T09:17:35.096ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26862025-02-23T09:17:35.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "01acbc1e-1d9a-4b06-a7df-f1fd8a852a36", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26872025-02-23T09:17:35.098ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26882025-02-23T09:17:35.100ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26892025-02-23T09:17:35.100ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.413499ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26902025-02-23T09:17:35.159ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26912025-02-23T09:17:35.167ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "afe99dfd-9755-4d8f-a782-db2b6f721a5b", "content-length": "691", "date": "Sun, 23 Feb 2025 09:17:34 GMT"} })
26922025-02-23T09:17:35.167ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26932025-02-23T09:17:35.167ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26942025-02-23T09:17:35.167ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26952025-02-23T09:17:35.168ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 641.319329ms iteration = 19 status = {}
26962025-02-23T09:17:35.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26972025-02-23T09:17:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26982025-02-23T09:17:35.186ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
26992025-02-23T09:17:35.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27002025-02-23T09:17:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27012025-02-23T09:17:35.197ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27022025-02-23T09:17:35.197ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab23627-8ab2-478c-80b1-d1f423c7e07a", "content-length": "134", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} })
27032025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27042025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
27052025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27062025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27072025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27082025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27092025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27102025-02-23T09:17:35.197ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27112025-02-23T09:17:35.198ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27122025-02-23T09:17:35.198ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27132025-02-23T09:17:35.198ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
27142025-02-23T09:17:35.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27152025-02-23T09:17:35.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27162025-02-23T09:17:35.199ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27172025-02-23T09:17:35.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1472b65d-0114-496a-8376-58cb633606f6", "content-length": "2", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} })
27182025-02-23T09:17:35.199ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27192025-02-23T09:17:35.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "72f17d1b-4e8c-4d85-9727-f04081436bf1", "content-length": "52", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} })
27202025-02-23T09:17:35.199ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
27212025-02-23T09:17:35.199ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27222025-02-23T09:17:35.367ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a45851e5-9491-49aa-a380-8979e5446ae4", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} })
27232025-02-23T09:17:35.367ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
27242025-02-23T09:17:35.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27252025-02-23T09:17:35.368ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "566e9b24-22dc-416a-8223-bf21c917e9a2", "content-length": "682", "date": "Sun, 23 Feb 2025 09:17:35 GMT"} })
27262025-02-23T09:17:35.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27272025-02-23T09:17:35.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27282025-02-23T09:17:35.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27292025-02-23T09:17:35.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27302025-02-23T09:17:35.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27312025-02-23T09:17:35.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27322025-02-23T09:17:35.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27332025-02-23T09:17:35.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27342025-02-23T09:17:35.384ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 856.948094ms iteration = 19 status = {}
27352025-02-23T09:17:35.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 57c7de89-9395-4fa4-a3af-b06d73c02609 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27362025-02-23T09:17:35.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 57c7de89-9395-4fa4-a3af-b06d73c02609 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27372025-02-23T09:17:35.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 57c7de89-9395-4fa4-a3af-b06d73c02609 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27382025-02-23T09:17:36.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 5b266807-8f15-4112-84b2-6c484902655a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
27392025-02-23T09:17:36.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 5b266807-8f15-4112-84b2-6c484902655a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
27402025-02-23T09:17:36.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 5b266807-8f15-4112-84b2-6c484902655a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
27412025-02-23T09:17:36.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5c84ed7e-84c8-45df-98b7-f5454236435d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27422025-02-23T09:17:36.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5c84ed7e-84c8-45df-98b7-f5454236435d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27432025-02-23T09:17:36.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5c84ed7e-84c8-45df-98b7-f5454236435d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27442025-02-23T09:17:37.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = f72c0fe7-ec5d-4c48-babb-23bee916de5e response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
27452025-02-23T09:17:37.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bee5515c-a476-48f8-afce-643bc962d028 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27462025-02-23T09:17:37.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bee5515c-a476-48f8-afce-643bc962d028 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27472025-02-23T09:17:37.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bee5515c-a476-48f8-afce-643bc962d028 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27482025-02-23T09:17:38.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 70b1e44a-c761-4302-ae0b-27c61189f56c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27492025-02-23T09:17:38.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 70b1e44a-c761-4302-ae0b-27c61189f56c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27502025-02-23T09:17:38.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 70b1e44a-c761-4302-ae0b-27c61189f56c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27512025-02-23T09:17:39.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bce52310-edc6-4f39-8a8c-5396bc2a08d8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27522025-02-23T09:17:39.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bce52310-edc6-4f39-8a8c-5396bc2a08d8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27532025-02-23T09:17:39.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bce52310-edc6-4f39-8a8c-5396bc2a08d8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27542025-02-23T09:17:40.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c0ef2807-9215-4bae-a282-eb1a6afa4563 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27552025-02-23T09:17:40.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c0ef2807-9215-4bae-a282-eb1a6afa4563 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27562025-02-23T09:17:40.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c0ef2807-9215-4bae-a282-eb1a6afa4563 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27572025-02-23T09:17:41.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b2390aed-a53b-48f7-8607-8ab020dcd84d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27582025-02-23T09:17:41.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b2390aed-a53b-48f7-8607-8ab020dcd84d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27592025-02-23T09:17:41.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b2390aed-a53b-48f7-8607-8ab020dcd84d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27602025-02-23T09:17:42.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b78a42ca-673a-4893-b695-25ee1b477e3e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27612025-02-23T09:17:42.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b78a42ca-673a-4893-b695-25ee1b477e3e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27622025-02-23T09:17:42.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b78a42ca-673a-4893-b695-25ee1b477e3e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27632025-02-23T09:17:43.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 279cdc5f-0359-4d8f-ba27-5f7f21565310 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27642025-02-23T09:17:43.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 279cdc5f-0359-4d8f-ba27-5f7f21565310 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27652025-02-23T09:17:43.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 279cdc5f-0359-4d8f-ba27-5f7f21565310 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27662025-02-23T09:17:44.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
27672025-02-23T09:17:44.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
27682025-02-23T09:17:44.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27692025-02-23T09:17:44.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27702025-02-23T09:17:44.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27712025-02-23T09:17:44.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27722025-02-23T09:17:44.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27732025-02-23T09:17:44.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27742025-02-23T09:17:44.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27752025-02-23T09:17:44.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27762025-02-23T09:17:44.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27772025-02-23T09:17:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27782025-02-23T09:17:44.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27792025-02-23T09:17:44.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
27802025-02-23T09:17:44.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27812025-02-23T09:17:44.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27822025-02-23T09:17:44.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
27832025-02-23T09:17:44.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.496263ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
27842025-02-23T09:17:44.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27852025-02-23T09:17:44.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27862025-02-23T09:17:44.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.228402ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27872025-02-23T09:17:44.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 228d6691-e8a4-4037-8688-98ef221d7259 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27882025-02-23T09:17:44.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 228d6691-e8a4-4037-8688-98ef221d7259 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27892025-02-23T09:17:44.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 228d6691-e8a4-4037-8688-98ef221d7259 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27902025-02-23T09:17:45.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 91ce5574-35c6-4edf-a620-fa729d3f2560 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27912025-02-23T09:17:45.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 91ce5574-35c6-4edf-a620-fa729d3f2560 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27922025-02-23T09:17:45.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 91ce5574-35c6-4edf-a620-fa729d3f2560 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27932025-02-23T09:17:46.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84c76799-2e98-47dd-8d3e-390af02847e7 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27942025-02-23T09:17:46.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84c76799-2e98-47dd-8d3e-390af02847e7 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27952025-02-23T09:17:46.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84c76799-2e98-47dd-8d3e-390af02847e7 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27962025-02-23T09:17:47.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 531 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 42123fda-dccc-429b-8fa5-8e15b9366996 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
27972025-02-23T09:17:47.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20eedddb-bf83-4a80-bfef-1d57046799e6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27982025-02-23T09:17:47.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20eedddb-bf83-4a80-bfef-1d57046799e6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27992025-02-23T09:17:47.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20eedddb-bf83-4a80-bfef-1d57046799e6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28002025-02-23T09:17:48.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb90e047-b6d5-4c5a-9147-bbcb8ea0584c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28012025-02-23T09:17:48.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb90e047-b6d5-4c5a-9147-bbcb8ea0584c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28022025-02-23T09:17:48.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb90e047-b6d5-4c5a-9147-bbcb8ea0584c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28032025-02-23T09:17:49.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ede737a4-7ff4-450c-b5ef-a370e29f091a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28042025-02-23T09:17:49.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ede737a4-7ff4-450c-b5ef-a370e29f091a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28052025-02-23T09:17:49.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ede737a4-7ff4-450c-b5ef-a370e29f091a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28062025-02-23T09:17:50.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b295f57b-fb34-457e-886c-38d0d3a34973 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28072025-02-23T09:17:50.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b295f57b-fb34-457e-886c-38d0d3a34973 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28082025-02-23T09:17:50.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b295f57b-fb34-457e-886c-38d0d3a34973 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28092025-02-23T09:17:51.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0d70e17b-d1bf-4526-92aa-109e6ff24f17 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28102025-02-23T09:17:51.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0d70e17b-d1bf-4526-92aa-109e6ff24f17 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28112025-02-23T09:17:51.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0d70e17b-d1bf-4526-92aa-109e6ff24f17 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28122025-02-23T09:17:53.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4c037525-c665-4fd2-8961-d3560894f481 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28132025-02-23T09:17:53.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4c037525-c665-4fd2-8961-d3560894f481 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28142025-02-23T09:17:53.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4c037525-c665-4fd2-8961-d3560894f481 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28152025-02-23T09:17:54.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4f14ff96-bda0-4dda-a809-edf00b4615e4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28162025-02-23T09:17:54.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4f14ff96-bda0-4dda-a809-edf00b4615e4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28172025-02-23T09:17:54.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4f14ff96-bda0-4dda-a809-edf00b4615e4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28182025-02-23T09:17:54.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
28192025-02-23T09:17:54.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
28202025-02-23T09:17:54.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28212025-02-23T09:17:54.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28222025-02-23T09:17:54.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28232025-02-23T09:17:54.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28242025-02-23T09:17:54.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28252025-02-23T09:17:54.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28262025-02-23T09:17:54.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28272025-02-23T09:17:54.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.522974ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28282025-02-23T09:17:54.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28292025-02-23T09:17:54.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28302025-02-23T09:17:54.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28312025-02-23T09:17:54.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322025-02-23T09:17:54.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28332025-02-23T09:17:54.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28342025-02-23T09:17:54.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
28352025-02-23T09:17:54.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28362025-02-23T09:17:54.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28372025-02-23T09:17:54.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
28382025-02-23T09:17:54.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.825809ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
28392025-02-23T09:17:55.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d44bd535-396e-4d21-9fbc-3021921446df roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28402025-02-23T09:17:55.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d44bd535-396e-4d21-9fbc-3021921446df resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28412025-02-23T09:17:55.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d44bd535-396e-4d21-9fbc-3021921446df response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28422025-02-23T09:17:56.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b173de8-ad5a-491d-ae38-a834f032e3cb roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28432025-02-23T09:17:56.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b173de8-ad5a-491d-ae38-a834f032e3cb resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28442025-02-23T09:17:56.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b173de8-ad5a-491d-ae38-a834f032e3cb response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28452025-02-23T09:17:57.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 16490dbe-c8ea-4a9c-ac70-2dc4c80baf59 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28462025-02-23T09:17:57.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 16490dbe-c8ea-4a9c-ac70-2dc4c80baf59 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28472025-02-23T09:17:57.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 16490dbe-c8ea-4a9c-ac70-2dc4c80baf59 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28482025-02-23T09:17:57.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = f2ade66d-ec0a-4f26-ba75-55c3f43323fd response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
28492025-02-23T09:17:58.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e99dd0d5-cf10-4ed8-bf4c-b4c2fcbfa0b1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28502025-02-23T09:17:58.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e99dd0d5-cf10-4ed8-bf4c-b4c2fcbfa0b1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28512025-02-23T09:17:58.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e99dd0d5-cf10-4ed8-bf4c-b4c2fcbfa0b1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28522025-02-23T09:17:59.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e1cbaa41-abf5-45d8-9b65-6ef7d1d08819 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28532025-02-23T09:17:59.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e1cbaa41-abf5-45d8-9b65-6ef7d1d08819 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28542025-02-23T09:17:59.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e1cbaa41-abf5-45d8-9b65-6ef7d1d08819 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28552025-02-23T09:18:00.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 10500460-092f-499a-83f4-71cc8d40d254 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28562025-02-23T09:18:00.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 10500460-092f-499a-83f4-71cc8d40d254 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28572025-02-23T09:18:00.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 10500460-092f-499a-83f4-71cc8d40d254 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28582025-02-23T09:18:01.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cee7d359-7e5d-4222-a8ec-c529a2aead54 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28592025-02-23T09:18:01.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cee7d359-7e5d-4222-a8ec-c529a2aead54 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28602025-02-23T09:18:01.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cee7d359-7e5d-4222-a8ec-c529a2aead54 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28612025-02-23T09:18:02.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f63ba197-4267-43df-99e2-71021b3d5153 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28622025-02-23T09:18:02.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f63ba197-4267-43df-99e2-71021b3d5153 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28632025-02-23T09:18:02.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f63ba197-4267-43df-99e2-71021b3d5153 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28642025-02-23T09:18:03.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0863f4f8-245c-4b47-9727-d1f95edc2e80 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28652025-02-23T09:18:03.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0863f4f8-245c-4b47-9727-d1f95edc2e80 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28662025-02-23T09:18:03.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0863f4f8-245c-4b47-9727-d1f95edc2e80 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28672025-02-23T09:18:04.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d3bb581-35f0-4a17-b319-0c17b2d78a0a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28682025-02-23T09:18:04.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d3bb581-35f0-4a17-b319-0c17b2d78a0a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28692025-02-23T09:18:04.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d3bb581-35f0-4a17-b319-0c17b2d78a0a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28702025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
28712025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28722025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
28732025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28742025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
28752025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28762025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
28772025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
28782025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28792025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
28802025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
28812025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28822025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
28832025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28842025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28852025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
28862025-02-23T09:18:04.527ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28872025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28882025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
28892025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28902025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
28912025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28922025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
28932025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28942025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
28952025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28962025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
28972025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28982025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28992025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29002025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29012025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29022025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29032025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29042025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29052025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29062025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29072025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29082025-02-23T09:18:04.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29092025-02-23T09:18:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29102025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
29112025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
29122025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
29132025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
29142025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29152025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
29162025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29172025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
29182025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29192025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
29202025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29212025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29222025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29232025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29242025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29252025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29262025-02-23T09:18:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29272025-02-23T09:18:04.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29282025-02-23T09:18:04.530ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29292025-02-23T09:18:04.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29302025-02-23T09:18:04.532ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36100, tv_nsec: 232469864 } })
29312025-02-23T09:18:04.532ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.863569ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29322025-02-23T09:18:04.533ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
29332025-02-23T09:18:04.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29342025-02-23T09:18:04.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29352025-02-23T09:18:04.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29362025-02-23T09:18:04.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29372025-02-23T09:18:04.535ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29382025-02-23T09:18:04.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29392025-02-23T09:18:04.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29402025-02-23T09:18:04.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29412025-02-23T09:18:04.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29422025-02-23T09:18:04.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29432025-02-23T09:18:04.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36100, tv_nsec: 237891236 } })
29442025-02-23T09:18:04.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
29452025-02-23T09:18:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29462025-02-23T09:18:04.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29472025-02-23T09:18:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29482025-02-23T09:18:04.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36100, tv_nsec: 260146292 } })
29492025-02-23T09:18:04.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29502025-02-23T09:18:04.560ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
29512025-02-23T09:18:04.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29522025-02-23T09:18:04.566ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 37.9321ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
29532025-02-23T09:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29542025-02-23T09:18:04.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.63306ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
29552025-02-23T09:18:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29562025-02-23T09:18:04.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.466352ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29572025-02-23T09:18:04.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29582025-02-23T09:18:04.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29592025-02-23T09:18:04.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29602025-02-23T09:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29612025-02-23T09:18:04.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29622025-02-23T09:18:04.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29632025-02-23T09:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29642025-02-23T09:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29652025-02-23T09:18:04.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29662025-02-23T09:18:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29672025-02-23T09:18:04.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29682025-02-23T09:18:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29692025-02-23T09:18:04.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29702025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29712025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29722025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29732025-02-23T09:18:04.611ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29742025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29752025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29762025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29772025-02-23T09:18:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29782025-02-23T09:18:04.613ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29792025-02-23T09:18:04.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.795895ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29802025-02-23T09:18:04.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29812025-02-23T09:18:04.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822025-02-23T09:18:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29832025-02-23T09:18:04.613ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29842025-02-23T09:18:04.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29852025-02-23T09:18:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29862025-02-23T09:18:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29872025-02-23T09:18:04.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29882025-02-23T09:18:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29892025-02-23T09:18:04.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29902025-02-23T09:18:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29912025-02-23T09:18:04.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29922025-02-23T09:18:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29932025-02-23T09:18:04.618ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29942025-02-23T09:18:04.618ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29952025-02-23T09:18:04.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29962025-02-23T09:18:04.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29972025-02-23T09:18:04.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
29982025-02-23T09:18:04.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29992025-02-23T09:18:04.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b782c77b-8f4c-47ef-901f-fa7c176e252a", "content-length": "26", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30002025-02-23T09:18:04.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30012025-02-23T09:18:04.620ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30022025-02-23T09:18:04.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30032025-02-23T09:18:04.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 94.277594ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
30042025-02-23T09:18:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30052025-02-23T09:18:04.624ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30062025-02-23T09:18:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30072025-02-23T09:18:04.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30082025-02-23T09:18:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
30092025-02-23T09:18:04.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30102025-02-23T09:18:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30112025-02-23T09:18:04.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30122025-02-23T09:18:04.675ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
30132025-02-23T09:18:04.675ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 148.430937ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
30142025-02-23T09:18:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30152025-02-23T09:18:04.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30162025-02-23T09:18:04.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30172025-02-23T09:18:04.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30182025-02-23T09:18:04.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30192025-02-23T09:18:04.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 156.862645ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30202025-02-23T09:18:04.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 155.993669ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30212025-02-23T09:18:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30222025-02-23T09:18:04.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30232025-02-23T09:18:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30242025-02-23T09:18:04.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.08611ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30252025-02-23T09:18:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
30262025-02-23T09:18:04.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30272025-02-23T09:18:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30282025-02-23T09:18:04.688ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
30292025-02-23T09:18:04.689ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 161.870809ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30302025-02-23T09:18:04.689ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 162.421969ms iteration = 20 status = 0
30312025-02-23T09:18:04.697ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30322025-02-23T09:18:04.697ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30332025-02-23T09:18:04.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.389779ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30342025-02-23T09:18:04.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
30352025-02-23T09:18:04.711ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30362025-02-23T09:18:04.712ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a12da6c3-8d56-4bc6-bd30-159d61a938ce", "content-length": "26", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30372025-02-23T09:18:04.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30382025-02-23T09:18:04.715ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30392025-02-23T09:18:04.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
30402025-02-23T09:18:04.735ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30412025-02-23T09:18:04.737ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2748ed-1d4a-49cc-8bdf-125e248e5e96", "content-length": "26", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30422025-02-23T09:18:04.737ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30432025-02-23T09:18:04.739ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 212.13903ms iteration = 20 status = {}
30442025-02-23T09:18:04.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
30452025-02-23T09:18:04.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30462025-02-23T09:18:04.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30472025-02-23T09:18:04.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 232.414209ms iteration = 22 status = {"physical_disks_added":0}
30482025-02-23T09:18:04.868ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30492025-02-23T09:18:04.869ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "67351241-7e63-481d-8b65-cd49f15c96b5", "content-length": "2", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30502025-02-23T09:18:04.870ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30512025-02-23T09:18:04.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30522025-02-23T09:18:04.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30532025-02-23T09:18:04.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30542025-02-23T09:18:04.873ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 345.977234ms iteration = 20 status = null
30552025-02-23T09:18:04.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30562025-02-23T09:18:04.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30572025-02-23T09:18:04.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30582025-02-23T09:18:04.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30592025-02-23T09:18:04.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602025-02-23T09:18:04.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30612025-02-23T09:18:04.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30622025-02-23T09:18:04.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30632025-02-23T09:18:04.887ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30642025-02-23T09:18:04.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30652025-02-23T09:18:04.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30662025-02-23T09:18:04.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30672025-02-23T09:18:04.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30682025-02-23T09:18:04.951ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
30692025-02-23T09:18:04.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30702025-02-23T09:18:04.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30712025-02-23T09:18:04.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30722025-02-23T09:18:04.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca7fa9f-f6d4-483e-a615-c82f3f06d785", "content-length": "134", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30732025-02-23T09:18:04.962ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30742025-02-23T09:18:04.962ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
30752025-02-23T09:18:04.962ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30762025-02-23T09:18:04.962ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30772025-02-23T09:18:04.962ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30782025-02-23T09:18:04.962ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30792025-02-23T09:18:04.963ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30802025-02-23T09:18:04.963ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30812025-02-23T09:18:04.963ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30822025-02-23T09:18:04.963ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30832025-02-23T09:18:04.963ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
30842025-02-23T09:18:04.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30852025-02-23T09:18:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30862025-02-23T09:18:04.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30872025-02-23T09:18:04.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "325c4fc3-1520-4009-869e-2d50d2649832", "content-length": "2", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30882025-02-23T09:18:04.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30892025-02-23T09:18:04.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84e9e257-e704-43d2-9aac-29da9cb9d546", "content-length": "52", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30902025-02-23T09:18:04.965ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
30912025-02-23T09:18:04.965ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30922025-02-23T09:18:04.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "517bd61a-0dd0-40a6-9bce-331a48c8dc5b", "content-length": "691", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30932025-02-23T09:18:04.982ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30942025-02-23T09:18:04.982ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30952025-02-23T09:18:04.982ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30962025-02-23T09:18:04.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6620f90-5654-4be4-a2ca-a26e3e586f14", "content-length": "372", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
30972025-02-23T09:18:04.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30982025-02-23T09:18:04.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30992025-02-23T09:18:04.984ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.140174ms iteration = 20 status = {}
31002025-02-23T09:18:05.003ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31012025-02-23T09:18:05.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31022025-02-23T09:18:05.005ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "699155b4-19b3-4d89-9d7b-768e0284395b", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
31032025-02-23T09:18:05.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31042025-02-23T09:18:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31052025-02-23T09:18:05.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31062025-02-23T09:18:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31072025-02-23T09:18:05.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31082025-02-23T09:18:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31092025-02-23T09:18:05.017ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31102025-02-23T09:18:05.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31112025-02-23T09:18:05.022ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "72d27034-8066-4a40-9a39-9f447e5f6d04", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
31122025-02-23T09:18:05.024ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 497.52227ms iteration = 20 status = {}
31132025-02-23T09:18:05.245ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "17975bec-4f9f-416c-8daa-a5f77dd43d20", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
31142025-02-23T09:18:05.245ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
31152025-02-23T09:18:05.245ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31162025-02-23T09:18:05.245ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "627dbb2f-b144-4985-af28-28fea49441e4", "content-length": "682", "date": "Sun, 23 Feb 2025 09:18:04 GMT"} })
31172025-02-23T09:18:05.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31182025-02-23T09:18:05.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31192025-02-23T09:18:05.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31202025-02-23T09:18:05.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31212025-02-23T09:18:05.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31222025-02-23T09:18:05.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31232025-02-23T09:18:05.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31242025-02-23T09:18:05.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31252025-02-23T09:18:05.263ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 736.156684ms iteration = 20 status = {}
31262025-02-23T09:18:05.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 70727bdf-2aba-45c9-ad6f-88ae71482f5e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31272025-02-23T09:18:05.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 70727bdf-2aba-45c9-ad6f-88ae71482f5e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31282025-02-23T09:18:05.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 70727bdf-2aba-45c9-ad6f-88ae71482f5e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31292025-02-23T09:18:06.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1856d22b-84d4-498b-ac3d-e227e2f4cde8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31302025-02-23T09:18:06.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1856d22b-84d4-498b-ac3d-e227e2f4cde8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31312025-02-23T09:18:06.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1856d22b-84d4-498b-ac3d-e227e2f4cde8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31322025-02-23T09:18:06.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = c2a8fb39-b504-423c-98ea-e0e9b4d814c3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
31332025-02-23T09:18:06.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = c2a8fb39-b504-423c-98ea-e0e9b4d814c3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
31342025-02-23T09:18:06.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = c2a8fb39-b504-423c-98ea-e0e9b4d814c3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
31352025-02-23T09:18:07.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = b140b3dd-fea1-42c5-b922-b064bcd4e55f response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
31362025-02-23T09:18:07.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dd918dfc-81de-494d-8093-fe7bc985a821 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31372025-02-23T09:18:07.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dd918dfc-81de-494d-8093-fe7bc985a821 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31382025-02-23T09:18:07.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dd918dfc-81de-494d-8093-fe7bc985a821 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31392025-02-23T09:18:08.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a5c17481-03b6-4d73-bafa-f3eb7f35bda3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31402025-02-23T09:18:08.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a5c17481-03b6-4d73-bafa-f3eb7f35bda3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31412025-02-23T09:18:08.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a5c17481-03b6-4d73-bafa-f3eb7f35bda3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31422025-02-23T09:18:09.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1e798a79-1a24-4dc2-b0f5-e814e9401b75 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31432025-02-23T09:18:09.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1e798a79-1a24-4dc2-b0f5-e814e9401b75 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31442025-02-23T09:18:09.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1e798a79-1a24-4dc2-b0f5-e814e9401b75 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31452025-02-23T09:18:10.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ac0437b4-3843-4a1b-a807-ea56a49c693c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31462025-02-23T09:18:10.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ac0437b4-3843-4a1b-a807-ea56a49c693c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31472025-02-23T09:18:10.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ac0437b4-3843-4a1b-a807-ea56a49c693c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31482025-02-23T09:18:11.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 13bd9269-de12-42f0-9ba4-958de552f712 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31492025-02-23T09:18:11.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 13bd9269-de12-42f0-9ba4-958de552f712 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31502025-02-23T09:18:11.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 13bd9269-de12-42f0-9ba4-958de552f712 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31512025-02-23T09:18:12.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1482353d-bded-42ae-a773-8f552de11ca1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31522025-02-23T09:18:12.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1482353d-bded-42ae-a773-8f552de11ca1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31532025-02-23T09:18:12.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1482353d-bded-42ae-a773-8f552de11ca1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31542025-02-23T09:18:13.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 49919f13-b624-422e-bbf7-cbf94a169098 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31552025-02-23T09:18:13.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 49919f13-b624-422e-bbf7-cbf94a169098 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31562025-02-23T09:18:13.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 49919f13-b624-422e-bbf7-cbf94a169098 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31572025-02-23T09:18:14.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a416c252-4167-4384-a4d2-707fa24dca2d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31582025-02-23T09:18:14.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a416c252-4167-4384-a4d2-707fa24dca2d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31592025-02-23T09:18:14.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a416c252-4167-4384-a4d2-707fa24dca2d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31602025-02-23T09:18:14.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
31612025-02-23T09:18:14.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
31622025-02-23T09:18:14.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31632025-02-23T09:18:14.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31642025-02-23T09:18:14.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31652025-02-23T09:18:14.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31662025-02-23T09:18:14.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672025-02-23T09:18:14.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31682025-02-23T09:18:14.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31692025-02-23T09:18:14.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31702025-02-23T09:18:14.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31712025-02-23T09:18:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31722025-02-23T09:18:14.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31732025-02-23T09:18:14.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
31742025-02-23T09:18:14.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31752025-02-23T09:18:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31762025-02-23T09:18:14.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
31772025-02-23T09:18:14.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.370745ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
31782025-02-23T09:18:14.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31792025-02-23T09:18:14.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31802025-02-23T09:18:14.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.435415ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31812025-02-23T09:18:15.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 58c17fe0-a3b2-4c71-98db-3641ba4587d0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31822025-02-23T09:18:15.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 58c17fe0-a3b2-4c71-98db-3641ba4587d0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31832025-02-23T09:18:15.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 58c17fe0-a3b2-4c71-98db-3641ba4587d0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31842025-02-23T09:18:16.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 010f4e1e-9a02-4096-afff-8f90c2314959 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31852025-02-23T09:18:16.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 010f4e1e-9a02-4096-afff-8f90c2314959 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31862025-02-23T09:18:16.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 010f4e1e-9a02-4096-afff-8f90c2314959 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31872025-02-23T09:18:17.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 075129e8-dc95-4a2e-a734-8328570daa50 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
31882025-02-23T09:18:17.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 075129e8-dc95-4a2e-a734-8328570daa50 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
31892025-02-23T09:18:17.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 075129e8-dc95-4a2e-a734-8328570daa50 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
31902025-02-23T09:18:17.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = b2465c98-70ff-467f-a19d-f8bbd10cff28 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
31912025-02-23T09:18:17.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = b2465c98-70ff-467f-a19d-f8bbd10cff28 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
31922025-02-23T09:18:17.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = b2465c98-70ff-467f-a19d-f8bbd10cff28 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
31932025-02-23T09:18:17.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = ed28459b-d190-4e2a-b8d7-2804cd4ef71c response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
31942025-02-23T09:18:17.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ee58197-9683-44c2-9452-fb74de3a1a9f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31952025-02-23T09:18:17.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ee58197-9683-44c2-9452-fb74de3a1a9f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31962025-02-23T09:18:17.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6ee58197-9683-44c2-9452-fb74de3a1a9f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31972025-02-23T09:18:18.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 122dc50f-3cfb-40c1-8397-b0be2a4a456c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31982025-02-23T09:18:18.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 122dc50f-3cfb-40c1-8397-b0be2a4a456c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
31992025-02-23T09:18:18.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 122dc50f-3cfb-40c1-8397-b0be2a4a456c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32002025-02-23T09:18:19.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a7a6944e-0521-42a9-b22c-ba42e366854c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32012025-02-23T09:18:19.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a7a6944e-0521-42a9-b22c-ba42e366854c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32022025-02-23T09:18:19.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a7a6944e-0521-42a9-b22c-ba42e366854c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32032025-02-23T09:18:20.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 94b1abb0-b361-4c18-946d-16af346c7980 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32042025-02-23T09:18:20.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 94b1abb0-b361-4c18-946d-16af346c7980 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32052025-02-23T09:18:20.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 94b1abb0-b361-4c18-946d-16af346c7980 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32062025-02-23T09:18:21.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0be2c88e-2680-4bc2-9af6-8d5eb501dd0b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32072025-02-23T09:18:21.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0be2c88e-2680-4bc2-9af6-8d5eb501dd0b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32082025-02-23T09:18:21.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0be2c88e-2680-4bc2-9af6-8d5eb501dd0b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32092025-02-23T09:18:22.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ee8fb4aa-04da-47b2-aa09-39588b62b4ed roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32102025-02-23T09:18:22.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ee8fb4aa-04da-47b2-aa09-39588b62b4ed resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32112025-02-23T09:18:22.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ee8fb4aa-04da-47b2-aa09-39588b62b4ed response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32122025-02-23T09:18:23.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a9111444-6772-419d-8daa-e07e643111d1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32132025-02-23T09:18:23.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a9111444-6772-419d-8daa-e07e643111d1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32142025-02-23T09:18:23.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a9111444-6772-419d-8daa-e07e643111d1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32152025-02-23T09:18:24.527ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
32162025-02-23T09:18:24.527ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
32172025-02-23T09:18:24.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32182025-02-23T09:18:24.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32192025-02-23T09:18:24.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32202025-02-23T09:18:24.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32212025-02-23T09:18:24.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222025-02-23T09:18:24.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32232025-02-23T09:18:24.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32242025-02-23T09:18:24.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32252025-02-23T09:18:24.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32262025-02-23T09:18:24.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32272025-02-23T09:18:24.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32282025-02-23T09:18:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32292025-02-23T09:18:24.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32302025-02-23T09:18:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
32312025-02-23T09:18:24.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32322025-02-23T09:18:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32332025-02-23T09:18:24.547ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
32342025-02-23T09:18:24.547ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.662887ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
32352025-02-23T09:18:24.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.188433ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32362025-02-23T09:18:24.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d3d98877-1de1-41e5-a076-9eedc72f53ff roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32372025-02-23T09:18:24.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d3d98877-1de1-41e5-a076-9eedc72f53ff resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32382025-02-23T09:18:24.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d3d98877-1de1-41e5-a076-9eedc72f53ff response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32392025-02-23T09:18:25.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 948bcd4f-1a34-4daf-9211-0970648a0f85 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32402025-02-23T09:18:25.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 948bcd4f-1a34-4daf-9211-0970648a0f85 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32412025-02-23T09:18:25.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 948bcd4f-1a34-4daf-9211-0970648a0f85 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32422025-02-23T09:18:26.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7af74dc-785b-4ab9-8fd2-e9655775903a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32432025-02-23T09:18:26.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7af74dc-785b-4ab9-8fd2-e9655775903a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32442025-02-23T09:18:26.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7af74dc-785b-4ab9-8fd2-e9655775903a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32452025-02-23T09:18:27.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 515 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 14a035d8-0bd1-41dc-bd9e-f7ea2e323953 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
32462025-02-23T09:18:27.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 45dc0055-5730-49b7-a5a3-d46f8b6db753 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32472025-02-23T09:18:27.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 45dc0055-5730-49b7-a5a3-d46f8b6db753 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32482025-02-23T09:18:27.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 45dc0055-5730-49b7-a5a3-d46f8b6db753 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32492025-02-23T09:18:28.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 617f1d57-8fe8-4154-9082-838d1ec3c588 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32502025-02-23T09:18:28.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 617f1d57-8fe8-4154-9082-838d1ec3c588 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32512025-02-23T09:18:28.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 617f1d57-8fe8-4154-9082-838d1ec3c588 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32522025-02-23T09:18:29.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e9b1824-3eee-4a64-8dca-4052f15f82ff roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32532025-02-23T09:18:29.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e9b1824-3eee-4a64-8dca-4052f15f82ff resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32542025-02-23T09:18:29.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e9b1824-3eee-4a64-8dca-4052f15f82ff response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32552025-02-23T09:18:30.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4857f231-7a56-4c96-bcb3-0c61840b6ea9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32562025-02-23T09:18:30.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4857f231-7a56-4c96-bcb3-0c61840b6ea9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32572025-02-23T09:18:30.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4857f231-7a56-4c96-bcb3-0c61840b6ea9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32582025-02-23T09:18:31.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2cebad2b-9e1d-4048-a0f6-f1c85b6ebec0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32592025-02-23T09:18:31.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2cebad2b-9e1d-4048-a0f6-f1c85b6ebec0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32602025-02-23T09:18:31.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2cebad2b-9e1d-4048-a0f6-f1c85b6ebec0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32612025-02-23T09:18:32.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 3b4f5b26-36c7-4317-83d2-2d7377bab8ab roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
32622025-02-23T09:18:32.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 3b4f5b26-36c7-4317-83d2-2d7377bab8ab resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
32632025-02-23T09:18:32.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 3b4f5b26-36c7-4317-83d2-2d7377bab8ab response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
32642025-02-23T09:18:32.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 2cbb37c8-b920-4d27-96d4-fc31807d9137 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
32652025-02-23T09:18:32.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 2cbb37c8-b920-4d27-96d4-fc31807d9137 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
32662025-02-23T09:18:32.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 2cbb37c8-b920-4d27-96d4-fc31807d9137 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
32672025-02-23T09:18:32.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e2670b9f-eaeb-4b46-90b7-1279fd51a534 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32682025-02-23T09:18:32.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e2670b9f-eaeb-4b46-90b7-1279fd51a534 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32692025-02-23T09:18:32.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e2670b9f-eaeb-4b46-90b7-1279fd51a534 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32702025-02-23T09:18:33.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f612101f-5ef4-4577-9549-c084a26adacc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32712025-02-23T09:18:33.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f612101f-5ef4-4577-9549-c084a26adacc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32722025-02-23T09:18:33.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f612101f-5ef4-4577-9549-c084a26adacc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
32732025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
32742025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
32752025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32762025-02-23T09:18:34.528ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32772025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32782025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
32792025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
32802025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32812025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32822025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32832025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
32842025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
32852025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
32862025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32872025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
32882025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
32892025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32902025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
32912025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
32922025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32932025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32942025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
32952025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32962025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
32972025-02-23T09:18:34.528ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
32982025-02-23T09:18:34.528ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
32992025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
33002025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
33012025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33022025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33032025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
33042025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33052025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
33062025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33072025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
33082025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33092025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
33102025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
33112025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
33122025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33132025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
33142025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33152025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33162025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
33172025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
33182025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
33192025-02-23T09:18:34.528ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:08:34.528535423 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33202025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
33212025-02-23T09:18:34.528ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
33222025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33232025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
33242025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.25\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
33252025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33262025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
33272025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
33282025-02-23T09:18:34.528ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
33292025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33302025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
33312025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
33322025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33332025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
33342025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33352025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33362025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
33372025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33382025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
33392025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
33402025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33412025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33422025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
33432025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33442025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33452025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
33462025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33472025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33482025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33492025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
33502025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33512025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
33522025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
33532025-02-23T09:18:34.528ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33542025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33552025-02-23T09:18:34.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33562025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33572025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33582025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33592025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33602025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
33612025-02-23T09:18:34.529ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
33622025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33632025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33642025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33652025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33662025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
33672025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33682025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33692025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33702025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33712025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33722025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33732025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33742025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33752025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33762025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
33772025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33782025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33792025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33802025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33812025-02-23T09:18:34.529ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 36130, tv_nsec: 228692303 } })
33822025-02-23T09:18:34.529ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 36130, tv_nsec: 228711183 } })
33832025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33842025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
33852025-02-23T09:18:34.529ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.284015ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
33862025-02-23T09:18:34.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
33872025-02-23T09:18:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.731812ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
33882025-02-23T09:18:34.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33892025-02-23T09:18:34.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33902025-02-23T09:18:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33912025-02-23T09:18:34.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33922025-02-23T09:18:34.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932025-02-23T09:18:34.533ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.718809ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33942025-02-23T09:18:34.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33952025-02-23T09:18:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33962025-02-23T09:18:34.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33972025-02-23T09:18:34.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33982025-02-23T09:18:34.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33992025-02-23T09:18:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34002025-02-23T09:18:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34012025-02-23T09:18:34.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34022025-02-23T09:18:34.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34032025-02-23T09:18:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34042025-02-23T09:18:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34052025-02-23T09:18:34.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34062025-02-23T09:18:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34072025-02-23T09:18:34.543ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.745966ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
34082025-02-23T09:18:34.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36130, tv_nsec: 243026961 } })
34092025-02-23T09:18:34.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
34102025-02-23T09:18:34.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.496265ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
34112025-02-23T09:18:34.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.834461ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
34122025-02-23T09:18:34.549ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34132025-02-23T09:18:34.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
34142025-02-23T09:18:34.553ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
34152025-02-23T09:18:34.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
34162025-02-23T09:18:34.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34172025-02-23T09:18:34.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34182025-02-23T09:18:34.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34192025-02-23T09:18:34.557ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:08:34.528535423 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34202025-02-23T09:18:34.557ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.589385ms iteration = 11 status = {"expiration":"2025-02-23T09:08:34.528535423Z","pruned":[]}
34212025-02-23T09:18:34.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34222025-02-23T09:18:34.558ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34232025-02-23T09:18:34.558ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34242025-02-23T09:18:34.558ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 29.95885ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34252025-02-23T09:18:34.572ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262025-02-23T09:18:34.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34272025-02-23T09:18:34.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34282025-02-23T09:18:34.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34292025-02-23T09:18:34.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36130, tv_nsec: 278688408 } })
34302025-02-23T09:18:34.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
34312025-02-23T09:18:34.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322025-02-23T09:18:34.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36130, tv_nsec: 289281697 } })
34332025-02-23T09:18:34.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
34342025-02-23T09:18:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34352025-02-23T09:18:34.592ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34362025-02-23T09:18:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34372025-02-23T09:18:34.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34382025-02-23T09:18:34.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34392025-02-23T09:18:34.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34402025-02-23T09:18:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34412025-02-23T09:18:34.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34422025-02-23T09:18:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34432025-02-23T09:18:34.610ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34442025-02-23T09:18:34.612ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34452025-02-23T09:18:34.612ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34462025-02-23T09:18:34.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34472025-02-23T09:18:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34482025-02-23T09:18:34.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
34492025-02-23T09:18:34.613ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
34502025-02-23T09:18:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
34512025-02-23T09:18:34.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34522025-02-23T09:18:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34532025-02-23T09:18:34.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34542025-02-23T09:18:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34552025-02-23T09:18:34.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34562025-02-23T09:18:34.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34572025-02-23T09:18:34.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34582025-02-23T09:18:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34592025-02-23T09:18:34.644ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
34602025-02-23T09:18:34.644ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 116.074792ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
34612025-02-23T09:18:34.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34622025-02-23T09:18:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34632025-02-23T09:18:34.650ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642025-02-23T09:18:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34652025-02-23T09:18:34.654ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34662025-02-23T09:18:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34672025-02-23T09:18:34.657ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682025-02-23T09:18:34.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34692025-02-23T09:18:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34702025-02-23T09:18:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
34712025-02-23T09:18:34.661ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34722025-02-23T09:18:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34732025-02-23T09:18:34.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742025-02-23T09:18:34.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34752025-02-23T09:18:34.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34762025-02-23T09:18:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34772025-02-23T09:18:34.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782025-02-23T09:18:34.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34792025-02-23T09:18:34.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34802025-02-23T09:18:34.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34812025-02-23T09:18:34.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34822025-02-23T09:18:34.676ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832025-02-23T09:18:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34842025-02-23T09:18:34.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34852025-02-23T09:18:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34862025-02-23T09:18:34.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34872025-02-23T09:18:34.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34882025-02-23T09:18:34.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34892025-02-23T09:18:34.686ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34902025-02-23T09:18:34.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34912025-02-23T09:18:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34922025-02-23T09:18:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34932025-02-23T09:18:34.687ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(dd2906aa-6149-466b-824f-06ab9b21ee59, 0), (19def323-61c3-42e4-9d9f-05bc20347869, 0), (21019fe9-8fd8-41e5-a6ff-bdb2ceed0068, 0)]
34942025-02-23T09:18:34.688ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36130, tv_nsec: 387457984 } })
34952025-02-23T09:18:34.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34962025-02-23T09:18:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34972025-02-23T09:18:34.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34982025-02-23T09:18:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34992025-02-23T09:18:34.691ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35002025-02-23T09:18:34.691ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 163.201384ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35012025-02-23T09:18:34.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35022025-02-23T09:18:34.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35032025-02-23T09:18:34.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35042025-02-23T09:18:34.695ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 167.373552ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
35052025-02-23T09:18:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
35062025-02-23T09:18:34.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35072025-02-23T09:18:34.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35082025-02-23T09:18:34.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
35092025-02-23T09:18:34.701ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35102025-02-23T09:18:34.702ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a10f03-ffd9-4a01-bdb5-457ec8df844e", "content-length": "26", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
35112025-02-23T09:18:34.702ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35122025-02-23T09:18:34.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35132025-02-23T09:18:34.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
35142025-02-23T09:18:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35152025-02-23T09:18:34.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35162025-02-23T09:18:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35172025-02-23T09:18:34.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35182025-02-23T09:18:34.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35192025-02-23T09:18:34.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 186.729834ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35202025-02-23T09:18:34.715ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35212025-02-23T09:18:34.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35222025-02-23T09:18:34.718ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35232025-02-23T09:18:34.718ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35242025-02-23T09:18:34.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35252025-02-23T09:18:34.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35262025-02-23T09:18:34.723ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35272025-02-23T09:18:34.723ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35282025-02-23T09:18:34.723ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35292025-02-23T09:18:34.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35302025-02-23T09:18:34.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35312025-02-23T09:18:34.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 202.276975ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35322025-02-23T09:18:34.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35332025-02-23T09:18:34.734ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35342025-02-23T09:18:34.734ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35352025-02-23T09:18:34.734ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 205.640848ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35362025-02-23T09:18:34.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35372025-02-23T09:18:34.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35382025-02-23T09:18:34.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35392025-02-23T09:18:34.746ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35402025-02-23T09:18:34.746ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35412025-02-23T09:18:34.746ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35422025-02-23T09:18:34.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35432025-02-23T09:18:34.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35442025-02-23T09:18:34.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452025-02-23T09:18:34.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35462025-02-23T09:18:34.751ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35472025-02-23T09:18:34.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35482025-02-23T09:18:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
35492025-02-23T09:18:34.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35502025-02-23T09:18:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35512025-02-23T09:18:34.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35522025-02-23T09:18:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35532025-02-23T09:18:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35542025-02-23T09:18:34.755ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35552025-02-23T09:18:34.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35562025-02-23T09:18:34.755ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572025-02-23T09:18:34.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35582025-02-23T09:18:34.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592025-02-23T09:18:34.757ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35602025-02-23T09:18:34.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35612025-02-23T09:18:34.757ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35622025-02-23T09:18:34.757ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35632025-02-23T09:18:34.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35642025-02-23T09:18:34.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35652025-02-23T09:18:34.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35662025-02-23T09:18:34.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35672025-02-23T09:18:34.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35682025-02-23T09:18:34.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35692025-02-23T09:18:34.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35702025-02-23T09:18:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35712025-02-23T09:18:34.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 232.658224ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35722025-02-23T09:18:34.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35732025-02-23T09:18:34.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35742025-02-23T09:18:34.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752025-02-23T09:18:34.763ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
35762025-02-23T09:18:34.763ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 234.896065ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
35772025-02-23T09:18:34.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35782025-02-23T09:18:34.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35792025-02-23T09:18:34.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35802025-02-23T09:18:34.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35812025-02-23T09:18:34.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35822025-02-23T09:18:34.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35832025-02-23T09:18:34.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35842025-02-23T09:18:34.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35852025-02-23T09:18:34.773ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35862025-02-23T09:18:34.773ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35872025-02-23T09:18:34.773ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
35882025-02-23T09:18:34.774ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 245.672427ms iteration = 11 status = {"generation":1}
35892025-02-23T09:18:34.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35902025-02-23T09:18:34.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35912025-02-23T09:18:34.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
35922025-02-23T09:18:34.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35932025-02-23T09:18:34.782ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
35942025-02-23T09:18:34.782ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 253.760239ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
35952025-02-23T09:18:34.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35962025-02-23T09:18:34.784ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35972025-02-23T09:18:34.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35982025-02-23T09:18:34.788ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 259.776101ms iteration = 21 status = 0
35992025-02-23T09:18:34.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36002025-02-23T09:18:34.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36012025-02-23T09:18:34.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36022025-02-23T09:18:34.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36032025-02-23T09:18:34.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36042025-02-23T09:18:34.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36052025-02-23T09:18:34.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36062025-02-23T09:18:34.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36072025-02-23T09:18:34.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082025-02-23T09:18:34.794ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36092025-02-23T09:18:34.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36102025-02-23T09:18:34.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36112025-02-23T09:18:34.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36122025-02-23T09:18:34.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36132025-02-23T09:18:34.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36142025-02-23T09:18:34.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36152025-02-23T09:18:34.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36162025-02-23T09:18:34.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36172025-02-23T09:18:34.799ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 271.046932ms iteration = 23 status = {"physical_disks_added":0}
36182025-02-23T09:18:34.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36192025-02-23T09:18:34.800ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36202025-02-23T09:18:34.800ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36212025-02-23T09:18:34.800ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 272.244374ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36222025-02-23T09:18:34.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36232025-02-23T09:18:34.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36242025-02-23T09:18:34.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36252025-02-23T09:18:34.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36262025-02-23T09:18:34.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36272025-02-23T09:18:34.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36282025-02-23T09:18:34.804ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36292025-02-23T09:18:34.804ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
36302025-02-23T09:18:34.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36312025-02-23T09:18:34.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36322025-02-23T09:18:34.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36332025-02-23T09:18:34.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36342025-02-23T09:18:34.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36352025-02-23T09:18:34.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36362025-02-23T09:18:34.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36372025-02-23T09:18:34.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36382025-02-23T09:18:34.815ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
36392025-02-23T09:18:34.815ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36402025-02-23T09:18:34.816ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3206d20-51c8-45da-bc22-2bfb98af0e6e", "content-length": "26", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36412025-02-23T09:18:34.816ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36422025-02-23T09:18:34.817ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36432025-02-23T09:18:34.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
36442025-02-23T09:18:34.821ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36452025-02-23T09:18:34.821ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "903761a0-f952-4949-936a-b5093ed59908", "content-length": "26", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36462025-02-23T09:18:34.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36472025-02-23T09:18:34.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36482025-02-23T09:18:34.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 311.084961ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36492025-02-23T09:18:34.840ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) }
36502025-02-23T09:18:34.840ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 312.197342ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36512025-02-23T09:18:34.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36522025-02-23T09:18:34.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36532025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
36542025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
36552025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
36562025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "983dcd99-68a2-4c26-8b76-ccae9e66f893", "content-length": "476", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36572025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
36582025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1badc82c-45e8-4d87-b313-047b67cab819", "content-length": "734", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36592025-02-23T09:18:34.901ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
36602025-02-23T09:18:34.902ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c8ea8b0-6637-4adc-9cd8-21a800d495b7", "content-length": "111", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36612025-02-23T09:18:34.902ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
36622025-02-23T09:18:34.902ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c21e02c5-fe6f-4577-909c-622f527428b8", "content-length": "111", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36632025-02-23T09:18:34.902ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
36642025-02-23T09:18:34.902ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93e3cd0f-f997-4192-81b5-a9598c014e1a", "content-length": "167", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36652025-02-23T09:18:34.902ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
36662025-02-23T09:18:34.903ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f15e9333-409a-42fc-bb38-5e6450fa8962", "content-length": "167", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36672025-02-23T09:18:34.903ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
36682025-02-23T09:18:34.903ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fd08d80-2a11-4155-b710-6c127bae03cc", "content-length": "175", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36692025-02-23T09:18:34.903ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
36702025-02-23T09:18:34.903ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6616643-b32d-42b7-98f8-0e6f2db78dcd", "content-length": "175", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36712025-02-23T09:18:34.903ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
36722025-02-23T09:18:34.904ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa7d8902-5417-41aa-9f2b-6d1ff83acdaf", "content-length": "702", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36732025-02-23T09:18:34.904ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
36742025-02-23T09:18:34.904ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8eb4f7a-4a69-4b0f-ba6c-5fb5b89929bd", "content-length": "727", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36752025-02-23T09:18:34.904ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
36762025-02-23T09:18:34.904ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cbc6b8c-86ec-45c0-83ae-7e4991ba44bc", "content-length": "729", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36772025-02-23T09:18:34.904ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
36782025-02-23T09:18:34.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 513d6bd1-8d91-458d-b692-34537223c6a1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
36792025-02-23T09:18:34.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 513d6bd1-8d91-458d-b692-34537223c6a1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
36802025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ce464ab-6e4b-43bf-a910-012e4925f36f", "content-length": "728", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36812025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
36822025-02-23T09:18:34.905ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
36832025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 376.75587ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36842025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "72bac431-6eb7-4eef-9204-6ceca33b4446", "content-length": "722", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36852025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
36862025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73792469-444d-4467-80b0-e13970b704b2", "content-length": "109", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36872025-02-23T09:18:34.905ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
36882025-02-23T09:18:34.906ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1274359f-c03a-4a10-ae37-11220bc0e767", "content-length": "109", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36892025-02-23T09:18:34.906ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
36902025-02-23T09:18:34.906ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30ece47a-db05-4f10-bcd7-038e95ac0d2d", "content-length": "169", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36912025-02-23T09:18:34.906ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
36922025-02-23T09:18:34.906ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e72f0b5-2f00-46a5-a229-ceade7d88e34", "content-length": "169", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36932025-02-23T09:18:34.906ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
36942025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7f46fb9-8fd9-4e8d-9a96-f1541026ed16", "content-length": "178", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36952025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
36962025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66ab2125-284b-42ff-bd0e-638270c698cb", "content-length": "178", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36972025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
36982025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2019f5ab-2642-47ce-80e0-a52d2f69f8c4", "content-length": "702", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
36992025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
37002025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eca2de15-9df1-4639-9c11-cd0473034980", "content-length": "727", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37012025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
37022025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "244d62ee-1fa3-4ced-8986-d47aed74815e", "content-length": "729", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37032025-02-23T09:18:34.907ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
37042025-02-23T09:18:34.908ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "acc7546f-1942-4e30-aaf4-652e7b93a19f", "content-length": "728", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37052025-02-23T09:18:34.908ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37062025-02-23T09:18:34.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37072025-02-23T09:18:34.961ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37082025-02-23T09:18:35.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37092025-02-23T09:18:35.002ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1f1185f3-726e-489b-ad11-3d7b0c797500", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37102025-02-23T09:18:35.002ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37112025-02-23T09:18:35.004ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5a4d262a-a33a-4374-9fcd-122189268da9", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37122025-02-23T09:18:35.004ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37132025-02-23T09:18:35.006ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37142025-02-23T09:18:35.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 477.984344ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37152025-02-23T09:18:35.041ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
37162025-02-23T09:18:35.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
37172025-02-23T09:18:35.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37182025-02-23T09:18:35.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37192025-02-23T09:18:35.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37202025-02-23T09:18:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37212025-02-23T09:18:35.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37222025-02-23T09:18:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37232025-02-23T09:18:35.049ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37242025-02-23T09:18:35.050ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a55aaf0e-9303-4834-8c1c-e2cccb9a1712", "content-length": "2", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37252025-02-23T09:18:35.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37262025-02-23T09:18:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37272025-02-23T09:18:35.057ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 529.553039ms iteration = 21 status = {}
37282025-02-23T09:18:35.065ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37292025-02-23T09:18:35.065ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37302025-02-23T09:18:35.066ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba1689a8-c64c-4a14-9623-7e7aa5d0f06e", "content-length": "372", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37312025-02-23T09:18:35.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37322025-02-23T09:18:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37332025-02-23T09:18:35.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37342025-02-23T09:18:35.068ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37352025-02-23T09:18:35.068ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
37362025-02-23T09:18:35.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 164357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 513d6bd1-8d91-458d-b692-34537223c6a1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
37372025-02-23T09:18:35.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 540.195158ms iteration = 5 status = {"blueprint_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","inventory_collection_id":"21019fe9-8fd8-41e5-a6ff-bdb2ceed0068","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
37382025-02-23T09:18:35.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37392025-02-23T09:18:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37402025-02-23T09:18:35.070ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
37412025-02-23T09:18:35.070ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37422025-02-23T09:18:35.070ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
37432025-02-23T09:18:35.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 542.155525ms iteration = 11 status = {"generation":2}
37442025-02-23T09:18:35.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37452025-02-23T09:18:35.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37462025-02-23T09:18:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37472025-02-23T09:18:35.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
37482025-02-23T09:18:35.071ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37492025-02-23T09:18:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37502025-02-23T09:18:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 544.785684ms iteration = 21 status = null
37512025-02-23T09:18:35.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37522025-02-23T09:18:35.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37532025-02-23T09:18:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37542025-02-23T09:18:35.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37552025-02-23T09:18:35.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37562025-02-23T09:18:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37572025-02-23T09:18:35.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37582025-02-23T09:18:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37592025-02-23T09:18:35.087ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37602025-02-23T09:18:35.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "25ecc09c-1580-4f82-9647-a93658ce4547", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37612025-02-23T09:18:35.087ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37622025-02-23T09:18:35.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "39fa46df-9e36-4844-abef-695facf148bb", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37632025-02-23T09:18:35.090ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37642025-02-23T09:18:35.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ff301097-b360-420a-bc1d-9fe7e57bdfbd", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37652025-02-23T09:18:35.093ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37662025-02-23T09:18:35.096ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37672025-02-23T09:18:35.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 567.798455ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37682025-02-23T09:18:35.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37692025-02-23T09:18:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37702025-02-23T09:18:35.112ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712025-02-23T09:18:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
37722025-02-23T09:18:35.114ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
37732025-02-23T09:18:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
37742025-02-23T09:18:35.114ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
37752025-02-23T09:18:35.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37762025-02-23T09:18:35.114ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-02-23T09:18:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37782025-02-23T09:18:35.115ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37792025-02-23T09:18:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37802025-02-23T09:18:35.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
37812025-02-23T09:18:35.117ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37822025-02-23T09:18:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37832025-02-23T09:18:35.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842025-02-23T09:18:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
37852025-02-23T09:18:35.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37862025-02-23T09:18:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37872025-02-23T09:18:35.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37882025-02-23T09:18:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37892025-02-23T09:18:35.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37902025-02-23T09:18:35.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37912025-02-23T09:18:35.129ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37922025-02-23T09:18:35.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37932025-02-23T09:18:35.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37942025-02-23T09:18:35.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
37952025-02-23T09:18:35.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "97c56ed2-0575-4e9d-a4fd-860c21fef6eb", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37962025-02-23T09:18:35.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37972025-02-23T09:18:35.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "28e7f932-f66e-478c-b236-34059afc4ef9", "content-length": "134", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
37982025-02-23T09:18:35.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37992025-02-23T09:18:35.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
38002025-02-23T09:18:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38012025-02-23T09:18:35.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "33d147a0-ac67-4150-93c8-8e2f020cb03f", "content-length": "2", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
38022025-02-23T09:18:35.129ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
38032025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38042025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38052025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38062025-02-23T09:18:35.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38072025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38082025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38092025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38102025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38112025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38122025-02-23T09:18:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38132025-02-23T09:18:35.130ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
38142025-02-23T09:18:35.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38152025-02-23T09:18:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38162025-02-23T09:18:35.131ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 602.983673ms iteration = 3 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b","time":"2025-02-23T09:13:34.886996829Z"},{"operation":"list","target_sled":"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b","time":"2025-02-23T09:18:35.129932953Z"}]}
38172025-02-23T09:18:35.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38182025-02-23T09:18:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38192025-02-23T09:18:35.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38202025-02-23T09:18:35.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38212025-02-23T09:18:35.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38222025-02-23T09:18:35.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3ef1546-ad49-46f6-b06f-b9418110f458", "content-length": "2", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
38232025-02-23T09:18:35.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38242025-02-23T09:18:35.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a33812-b707-4c94-adec-3442f081f517", "content-length": "52", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
38252025-02-23T09:18:35.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
38262025-02-23T09:18:35.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38272025-02-23T09:18:35.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38282025-02-23T09:18:35.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38292025-02-23T09:18:35.138ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38302025-02-23T09:18:35.138ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38312025-02-23T09:18:35.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38322025-02-23T09:18:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38332025-02-23T09:18:35.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38342025-02-23T09:18:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38352025-02-23T09:18:35.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38362025-02-23T09:18:35.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
38372025-02-23T09:18:35.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38382025-02-23T09:18:35.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38392025-02-23T09:18:35.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38402025-02-23T09:18:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38412025-02-23T09:18:35.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38422025-02-23T09:18:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38432025-02-23T09:18:35.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38442025-02-23T09:18:35.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
38452025-02-23T09:18:35.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38462025-02-23T09:18:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38472025-02-23T09:18:35.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38482025-02-23T09:18:35.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38492025-02-23T09:18:35.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38502025-02-23T09:18:35.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38512025-02-23T09:18:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38522025-02-23T09:18:35.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38532025-02-23T09:18:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38542025-02-23T09:18:35.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38552025-02-23T09:18:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38562025-02-23T09:18:35.211ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
38572025-02-23T09:18:35.211ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
38582025-02-23T09:18:35.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38592025-02-23T09:18:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38602025-02-23T09:18:35.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38612025-02-23T09:18:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38622025-02-23T09:18:35.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38632025-02-23T09:18:35.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38642025-02-23T09:18:35.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652025-02-23T09:18:35.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
38662025-02-23T09:18:35.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38672025-02-23T09:18:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38682025-02-23T09:18:35.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38692025-02-23T09:18:35.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38702025-02-23T09:18:35.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38712025-02-23T09:18:35.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38722025-02-23T09:18:35.228ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38732025-02-23T09:18:35.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
38742025-02-23T09:18:35.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38752025-02-23T09:18:35.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38762025-02-23T09:18:35.239ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
38772025-02-23T09:18:35.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38782025-02-23T09:18:35.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38792025-02-23T09:18:35.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38802025-02-23T09:18:35.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
38812025-02-23T09:18:35.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38822025-02-23T09:18:35.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38832025-02-23T09:18:35.244ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
38842025-02-23T09:18:35.244ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
38852025-02-23T09:18:35.244ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
38862025-02-23T09:18:35.247ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4e84d856-89cb-48b7-97b8-1f1a1bcb57b1", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
38872025-02-23T09:18:35.247ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
38882025-02-23T09:18:35.247ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38892025-02-23T09:18:35.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7ee189-065e-454e-8805-785d169f354e", "content-length": "682", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} })
38902025-02-23T09:18:35.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38912025-02-23T09:18:35.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38922025-02-23T09:18:35.248ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e0b5e02-ad09-45b8-b41b-4e0f7e0132d2", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} })
38932025-02-23T09:18:35.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d33b61e-fabd-444a-b66f-2e3910663ba0", "content-length": "691", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} })
38942025-02-23T09:18:35.249ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38952025-02-23T09:18:35.249ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38962025-02-23T09:18:35.249ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38972025-02-23T09:18:35.250ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 721.886828ms iteration = 21 status = {}
38982025-02-23T09:18:35.251ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 722.458568ms iteration = 21 status = {}
38992025-02-23T09:18:35.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39002025-02-23T09:18:35.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39012025-02-23T09:18:35.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39022025-02-23T09:18:35.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39032025-02-23T09:18:35.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39042025-02-23T09:18:35.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39052025-02-23T09:18:35.266ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 738.05325ms iteration = 21 status = {}
39062025-02-23T09:18:35.378ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, time_created: 2025-02-23T09:08:53.408888Z, time_modified: 2025-02-23T09:08:53.408888Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
39072025-02-23T09:18:35.378ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
39082025-02-23T09:18:35.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39092025-02-23T09:18:35.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39102025-02-23T09:18:35.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39112025-02-23T09:18:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39122025-02-23T09:18:35.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132025-02-23T09:18:35.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
39142025-02-23T09:18:35.417ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
39152025-02-23T09:18:35.417ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "378ac490-ebea-4363-8b7e-4a0920890c69", "date": "Sun, 23 Feb 2025 09:18:34 GMT"} })
39162025-02-23T09:18:35.418ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
39172025-02-23T09:18:35.418ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 890.299299ms
39182025-02-23T09:18:35.418ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 890.308459ms iteration = 3 status = {}
39192025-02-23T09:18:35.684ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b7c72c4-6bac-467c-8d9f-ad7ac27bb1fe", "content-length": "31977", "date": "Sun, 23 Feb 2025 09:18:35 GMT"} })
39202025-02-23T09:18:35.686ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
39212025-02-23T09:18:35.686ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
39222025-02-23T09:18:35.686ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
39232025-02-23T09:18:35.688ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
39242025-02-23T09:18:35.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39252025-02-23T09:18:35.690ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262025-02-23T09:18:35.692ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
39272025-02-23T09:18:35.692ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
39282025-02-23T09:18:35.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39292025-02-23T09:18:35.878ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = b392ade4-b33c-4a68-ad31-9085c42ba626 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
39302025-02-23T09:18:35.878ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = b392ade4-b33c-4a68-ad31-9085c42ba626 time_started = 2025-02-23 09:18:34.901032 UTC
39312025-02-23T09:18:35.878ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
39322025-02-23T09:18:35.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39332025-02-23T09:18:35.878ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.350262056s iteration = 3 status = {"collection_id":"b392ade4-b33c-4a68-ad31-9085c42ba626","time_done":"2025-02-23 09:18:35.686513 UTC","time_started":"2025-02-23 09:18:34.901032 UTC"}
39342025-02-23T09:18:35.878ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
39352025-02-23T09:18:35.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39362025-02-23T09:18:35.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39372025-02-23T09:18:35.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39382025-02-23T09:18:35.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392025-02-23T09:18:35.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39402025-02-23T09:18:35.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39412025-02-23T09:18:35.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39422025-02-23T09:18:35.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39432025-02-23T09:18:35.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
39442025-02-23T09:18:35.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39452025-02-23T09:18:35.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39462025-02-23T09:18:35.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39472025-02-23T09:18:35.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39482025-02-23T09:18:35.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39492025-02-23T09:18:35.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39502025-02-23T09:18:35.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39512025-02-23T09:18:35.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39522025-02-23T09:18:35.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39532025-02-23T09:18:35.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39542025-02-23T09:18:35.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39552025-02-23T09:18:35.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39562025-02-23T09:18:35.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39572025-02-23T09:18:35.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
39582025-02-23T09:18:35.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39592025-02-23T09:18:35.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39602025-02-23T09:18:35.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39612025-02-23T09:18:35.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
39622025-02-23T09:18:35.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39632025-02-23T09:18:35.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39642025-02-23T09:18:35.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39652025-02-23T09:18:35.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39662025-02-23T09:18:35.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672025-02-23T09:18:35.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
39682025-02-23T09:18:35.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39692025-02-23T09:18:35.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39702025-02-23T09:18:35.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39712025-02-23T09:18:35.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
39722025-02-23T09:18:35.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39732025-02-23T09:18:35.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39742025-02-23T09:18:35.945ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
39752025-02-23T09:18:35.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 66.348432ms iteration = 6 status = {"blueprint_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","inventory_collection_id":"36f8bc37-dfc3-4416-ab25-a0ce37df79cb","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
39762025-02-23T09:18:35.997ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.767032ms iteration = 24 status = {"physical_disks_added":0}
39772025-02-23T09:18:36.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0c92f4c2-d881-4b27-90b8-ae4c1d269dc5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39782025-02-23T09:18:36.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0c92f4c2-d881-4b27-90b8-ae4c1d269dc5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39792025-02-23T09:18:36.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0c92f4c2-d881-4b27-90b8-ae4c1d269dc5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39802025-02-23T09:18:36.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d53c8151-c2d7-415b-8509-30de2cbfeaa9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
39812025-02-23T09:18:36.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d53c8151-c2d7-415b-8509-30de2cbfeaa9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
39822025-02-23T09:18:36.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d53c8151-c2d7-415b-8509-30de2cbfeaa9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
39832025-02-23T09:18:37.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 41432b82-a11e-4798-bee4-c1ec29b6c453 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39842025-02-23T09:18:37.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 41432b82-a11e-4798-bee4-c1ec29b6c453 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39852025-02-23T09:18:37.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 41432b82-a11e-4798-bee4-c1ec29b6c453 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39862025-02-23T09:18:37.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 7f4768f6-0aca-4e42-af0e-27f8490bc5de response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
39872025-02-23T09:18:38.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7cdfc069-4ec9-4882-ba38-04c9d0eab910 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39882025-02-23T09:18:38.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7cdfc069-4ec9-4882-ba38-04c9d0eab910 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39892025-02-23T09:18:38.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7cdfc069-4ec9-4882-ba38-04c9d0eab910 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39902025-02-23T09:18:39.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 872f0a5f-9e11-40e0-bd91-9a9d3bb9b8a8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39912025-02-23T09:18:39.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 872f0a5f-9e11-40e0-bd91-9a9d3bb9b8a8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39922025-02-23T09:18:39.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 872f0a5f-9e11-40e0-bd91-9a9d3bb9b8a8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39932025-02-23T09:18:40.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d06bf48b-66d6-4681-bbfc-3be48d01633e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39942025-02-23T09:18:40.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d06bf48b-66d6-4681-bbfc-3be48d01633e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39952025-02-23T09:18:40.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d06bf48b-66d6-4681-bbfc-3be48d01633e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39962025-02-23T09:18:41.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c91af9f1-6001-4df3-909d-f1938010ba09 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39972025-02-23T09:18:41.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c91af9f1-6001-4df3-909d-f1938010ba09 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39982025-02-23T09:18:41.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c91af9f1-6001-4df3-909d-f1938010ba09 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
39992025-02-23T09:18:42.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 69f6cd1e-65a0-4369-8bd0-7db9de17c11c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40002025-02-23T09:18:42.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 69f6cd1e-65a0-4369-8bd0-7db9de17c11c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40012025-02-23T09:18:42.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 69f6cd1e-65a0-4369-8bd0-7db9de17c11c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40022025-02-23T09:18:43.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d7700798-ae91-41c7-b057-a17e22d0ea2c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40032025-02-23T09:18:43.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d7700798-ae91-41c7-b057-a17e22d0ea2c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40042025-02-23T09:18:43.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d7700798-ae91-41c7-b057-a17e22d0ea2c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40052025-02-23T09:18:44.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6536ca19-ffa4-4baf-b4a1-e014ff4470f3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40062025-02-23T09:18:44.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6536ca19-ffa4-4baf-b4a1-e014ff4470f3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40072025-02-23T09:18:44.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6536ca19-ffa4-4baf-b4a1-e014ff4470f3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40082025-02-23T09:18:44.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
40092025-02-23T09:18:44.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
40102025-02-23T09:18:44.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40112025-02-23T09:18:44.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40122025-02-23T09:18:44.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40132025-02-23T09:18:44.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40142025-02-23T09:18:44.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152025-02-23T09:18:44.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40162025-02-23T09:18:44.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40172025-02-23T09:18:44.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40182025-02-23T09:18:44.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40192025-02-23T09:18:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202025-02-23T09:18:44.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212025-02-23T09:18:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
40222025-02-23T09:18:44.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40232025-02-23T09:18:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40242025-02-23T09:18:44.549ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
40252025-02-23T09:18:44.549ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.072214ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
40262025-02-23T09:18:44.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40272025-02-23T09:18:44.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40282025-02-23T09:18:44.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.807311ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40292025-02-23T09:18:45.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dfaa2cba-5045-4e3d-b7c2-1965c1d42589 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40302025-02-23T09:18:45.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dfaa2cba-5045-4e3d-b7c2-1965c1d42589 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40312025-02-23T09:18:45.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dfaa2cba-5045-4e3d-b7c2-1965c1d42589 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40322025-02-23T09:18:46.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c6bb8ae6-7568-4c2c-9efc-9669350af445 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40332025-02-23T09:18:46.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c6bb8ae6-7568-4c2c-9efc-9669350af445 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40342025-02-23T09:18:46.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c6bb8ae6-7568-4c2c-9efc-9669350af445 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40352025-02-23T09:18:47.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 5e82618c-beda-430a-9516-659dbbcb8252 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
40362025-02-23T09:18:47.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 5e82618c-beda-430a-9516-659dbbcb8252 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
40372025-02-23T09:18:47.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 5e82618c-beda-430a-9516-659dbbcb8252 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
40382025-02-23T09:18:47.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = eb35d832-3831-48f1-9aa9-2ceb105123d6 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
40392025-02-23T09:18:47.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = eb35d832-3831-48f1-9aa9-2ceb105123d6 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
40402025-02-23T09:18:47.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = eb35d832-3831-48f1-9aa9-2ceb105123d6 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
40412025-02-23T09:18:47.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 656 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = e2a8e2d7-a4e1-4530-b290-85a31d1d85ae response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
40422025-02-23T09:18:47.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bb853f0b-55c9-49e5-86a1-9a5776a3739c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40432025-02-23T09:18:47.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bb853f0b-55c9-49e5-86a1-9a5776a3739c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40442025-02-23T09:18:47.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bb853f0b-55c9-49e5-86a1-9a5776a3739c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40452025-02-23T09:18:48.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e512028a-4cda-41d2-ae3b-062e879594ac roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40462025-02-23T09:18:48.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e512028a-4cda-41d2-ae3b-062e879594ac resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40472025-02-23T09:18:48.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e512028a-4cda-41d2-ae3b-062e879594ac response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40482025-02-23T09:18:49.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7af7f506-7b10-431f-b533-945ac0a9ad50 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40492025-02-23T09:18:49.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7af7f506-7b10-431f-b533-945ac0a9ad50 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40502025-02-23T09:18:49.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7af7f506-7b10-431f-b533-945ac0a9ad50 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40512025-02-23T09:18:50.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dfd25bb0-8837-4106-b017-f96a85b708e4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40522025-02-23T09:18:50.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dfd25bb0-8837-4106-b017-f96a85b708e4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40532025-02-23T09:18:50.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dfd25bb0-8837-4106-b017-f96a85b708e4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40542025-02-23T09:18:51.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7193d97-3e3a-4133-ba58-47089071657b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40552025-02-23T09:18:51.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7193d97-3e3a-4133-ba58-47089071657b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40562025-02-23T09:18:51.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c7193d97-3e3a-4133-ba58-47089071657b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40572025-02-23T09:18:52.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9e0ca013-599c-44cc-96e5-1d11aa891eba roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40582025-02-23T09:18:52.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9e0ca013-599c-44cc-96e5-1d11aa891eba resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40592025-02-23T09:18:52.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9e0ca013-599c-44cc-96e5-1d11aa891eba response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40602025-02-23T09:18:53.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 58df7453-b780-45f6-b0af-05d5e11198e1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40612025-02-23T09:18:53.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 58df7453-b780-45f6-b0af-05d5e11198e1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40622025-02-23T09:18:53.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 58df7453-b780-45f6-b0af-05d5e11198e1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40632025-02-23T09:18:54.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b957c3c5-ff2f-49ba-890b-66ef0cddb246 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40642025-02-23T09:18:54.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b957c3c5-ff2f-49ba-890b-66ef0cddb246 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40652025-02-23T09:18:54.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b957c3c5-ff2f-49ba-890b-66ef0cddb246 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40662025-02-23T09:18:54.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
40672025-02-23T09:18:54.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40682025-02-23T09:18:54.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
40692025-02-23T09:18:54.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40702025-02-23T09:18:54.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40712025-02-23T09:18:54.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40722025-02-23T09:18:54.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732025-02-23T09:18:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40742025-02-23T09:18:54.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40752025-02-23T09:18:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40762025-02-23T09:18:54.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40772025-02-23T09:18:54.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40782025-02-23T09:18:54.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40792025-02-23T09:18:54.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
40802025-02-23T09:18:54.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40812025-02-23T09:18:54.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40822025-02-23T09:18:54.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
40832025-02-23T09:18:54.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.694572ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
40842025-02-23T09:18:54.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40852025-02-23T09:18:54.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40862025-02-23T09:18:54.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.178319ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40872025-02-23T09:18:55.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20c98179-e6cf-4cf0-9643-755331fd6ec7 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40882025-02-23T09:18:55.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20c98179-e6cf-4cf0-9643-755331fd6ec7 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40892025-02-23T09:18:55.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20c98179-e6cf-4cf0-9643-755331fd6ec7 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40902025-02-23T09:18:56.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 17e5ad6d-5f6d-452c-afda-bf1b732643bc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40912025-02-23T09:18:56.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 17e5ad6d-5f6d-452c-afda-bf1b732643bc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40922025-02-23T09:18:56.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 17e5ad6d-5f6d-452c-afda-bf1b732643bc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40932025-02-23T09:18:57.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 659 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 240367c4-6338-4fd0-90e6-cfa913adc405 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
40942025-02-23T09:18:57.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b06f0632-e244-4608-95c6-a006141795c4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40952025-02-23T09:18:57.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b06f0632-e244-4608-95c6-a006141795c4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40962025-02-23T09:18:57.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b06f0632-e244-4608-95c6-a006141795c4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40972025-02-23T09:18:58.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a2b6396-f425-4ee3-8f04-07547794f328 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40982025-02-23T09:18:58.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a2b6396-f425-4ee3-8f04-07547794f328 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
40992025-02-23T09:18:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4a2b6396-f425-4ee3-8f04-07547794f328 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41002025-02-23T09:18:59.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a17267d3-4963-4491-83e3-5eaae73d7dc5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41012025-02-23T09:18:59.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a17267d3-4963-4491-83e3-5eaae73d7dc5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41022025-02-23T09:18:59.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a17267d3-4963-4491-83e3-5eaae73d7dc5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41032025-02-23T09:19:00.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84786849-4265-43e6-87ab-7eb73cfaebdc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41042025-02-23T09:19:00.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84786849-4265-43e6-87ab-7eb73cfaebdc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41052025-02-23T09:19:00.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 84786849-4265-43e6-87ab-7eb73cfaebdc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41062025-02-23T09:19:01.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5abb7049-29fc-459e-af0b-8dd3944c89ea roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41072025-02-23T09:19:01.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5abb7049-29fc-459e-af0b-8dd3944c89ea resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41082025-02-23T09:19:01.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5abb7049-29fc-459e-af0b-8dd3944c89ea response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41092025-02-23T09:19:02.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = a6596af2-0993-4af1-8734-c821b71b5971 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
41102025-02-23T09:19:02.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = a6596af2-0993-4af1-8734-c821b71b5971 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
41112025-02-23T09:19:02.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = a6596af2-0993-4af1-8734-c821b71b5971 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
41122025-02-23T09:19:02.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 66a1474d-973d-45f6-821b-a5c4985386d7 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
41132025-02-23T09:19:02.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 66a1474d-973d-45f6-821b-a5c4985386d7 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
41142025-02-23T09:19:02.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 66a1474d-973d-45f6-821b-a5c4985386d7 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
41152025-02-23T09:19:02.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d63f51c3-6a9e-4e63-ada6-3352099303b6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41162025-02-23T09:19:02.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d63f51c3-6a9e-4e63-ada6-3352099303b6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41172025-02-23T09:19:02.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d63f51c3-6a9e-4e63-ada6-3352099303b6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41182025-02-23T09:19:03.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = be4e8313-4f55-45d7-bb02-289d8545ef87 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41192025-02-23T09:19:03.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = be4e8313-4f55-45d7-bb02-289d8545ef87 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41202025-02-23T09:19:03.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = be4e8313-4f55-45d7-bb02-289d8545ef87 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
41212025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
41222025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
41232025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41242025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41252025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
41262025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41272025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
41282025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
41292025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
41302025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41312025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41322025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
41332025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
41342025-02-23T09:19:04.528ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41352025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41362025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
41372025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41382025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41392025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
41402025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41412025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
41422025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41432025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41442025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
41452025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
41462025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41472025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41482025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
41492025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41502025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41512025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41522025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41532025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41542025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41552025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41562025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
41572025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41582025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41592025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
41602025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
41612025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
41622025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41632025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
41642025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41652025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41662025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41672025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41682025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41692025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
41702025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41712025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41722025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41732025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41742025-02-23T09:19:04.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41752025-02-23T09:19:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41762025-02-23T09:19:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41772025-02-23T09:19:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
41782025-02-23T09:19:04.533ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41792025-02-23T09:19:04.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802025-02-23T09:19:04.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.782125ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41812025-02-23T09:19:04.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41822025-02-23T09:19:04.536ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41832025-02-23T09:19:04.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41842025-02-23T09:19:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41852025-02-23T09:19:04.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41862025-02-23T09:19:04.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41872025-02-23T09:19:04.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41882025-02-23T09:19:04.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41892025-02-23T09:19:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41902025-02-23T09:19:04.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912025-02-23T09:19:04.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41922025-02-23T09:19:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41932025-02-23T09:19:04.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41942025-02-23T09:19:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41952025-02-23T09:19:04.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36160, tv_nsec: 242504993 } })
41962025-02-23T09:19:04.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
41972025-02-23T09:19:04.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982025-02-23T09:19:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41992025-02-23T09:19:04.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42002025-02-23T09:19:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42012025-02-23T09:19:04.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36160, tv_nsec: 246325525 } })
42022025-02-23T09:19:04.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42032025-02-23T09:19:04.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42042025-02-23T09:19:04.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
42052025-02-23T09:19:04.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42062025-02-23T09:19:04.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42072025-02-23T09:19:04.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42082025-02-23T09:19:04.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42092025-02-23T09:19:04.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.471484ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42102025-02-23T09:19:04.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36160, tv_nsec: 255440465 } })
42112025-02-23T09:19:04.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
42122025-02-23T09:19:04.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42132025-02-23T09:19:04.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42142025-02-23T09:19:04.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42152025-02-23T09:19:04.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42162025-02-23T09:19:04.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42172025-02-23T09:19:04.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42182025-02-23T09:19:04.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42192025-02-23T09:19:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42202025-02-23T09:19:04.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42212025-02-23T09:19:04.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42222025-02-23T09:19:04.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42232025-02-23T09:19:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42242025-02-23T09:19:04.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42252025-02-23T09:19:04.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42262025-02-23T09:19:04.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42272025-02-23T09:19:04.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42282025-02-23T09:19:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42292025-02-23T09:19:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42302025-02-23T09:19:04.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42312025-02-23T09:19:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42322025-02-23T09:19:04.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42332025-02-23T09:19:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42342025-02-23T09:19:04.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.309017ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
42352025-02-23T09:19:04.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42362025-02-23T09:19:04.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42372025-02-23T09:19:04.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42382025-02-23T09:19:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42392025-02-23T09:19:04.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42402025-02-23T09:19:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42412025-02-23T09:19:04.616ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42422025-02-23T09:19:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42432025-02-23T09:19:04.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42442025-02-23T09:19:04.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42452025-02-23T09:19:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42462025-02-23T09:19:04.618ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472025-02-23T09:19:04.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42482025-02-23T09:19:04.620ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 91.810687ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
42492025-02-23T09:19:04.620ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42502025-02-23T09:19:04.620ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.609762ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42512025-02-23T09:19:04.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42522025-02-23T09:19:04.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42532025-02-23T09:19:04.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42542025-02-23T09:19:04.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.441539ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
42552025-02-23T09:19:04.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42562025-02-23T09:19:04.622ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42572025-02-23T09:19:04.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42582025-02-23T09:19:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
42592025-02-23T09:19:04.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42602025-02-23T09:19:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42612025-02-23T09:19:04.645ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
42622025-02-23T09:19:04.645ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.383146ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
42632025-02-23T09:19:04.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
42642025-02-23T09:19:04.645ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42652025-02-23T09:19:04.645ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1afb22cf-35c2-43b2-9ea7-177ae2fc0e6d", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
42662025-02-23T09:19:04.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42672025-02-23T09:19:04.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
42682025-02-23T09:19:04.646ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42692025-02-23T09:19:04.646ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7777839-bebd-40a6-86a9-e5852e1d6ebd", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
42702025-02-23T09:19:04.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42712025-02-23T09:19:04.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 119.104789ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42722025-02-23T09:19:04.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42732025-02-23T09:19:04.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42742025-02-23T09:19:04.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.557745ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42752025-02-23T09:19:04.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42762025-02-23T09:19:04.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42772025-02-23T09:19:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42782025-02-23T09:19:04.671ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42792025-02-23T09:19:04.671ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42802025-02-23T09:19:04.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42812025-02-23T09:19:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
42822025-02-23T09:19:04.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42832025-02-23T09:19:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42842025-02-23T09:19:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42852025-02-23T09:19:04.674ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.660734ms iteration = 22 status = 0
42862025-02-23T09:19:04.676ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
42872025-02-23T09:19:04.676ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 148.618191ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42882025-02-23T09:19:04.677ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
42892025-02-23T09:19:04.677ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42902025-02-23T09:19:04.678ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f9f7f5c-9c59-4593-a155-bd72b30816b3", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
42912025-02-23T09:19:04.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42922025-02-23T09:19:04.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
42932025-02-23T09:19:04.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b7fa21ba-3101-46ff-8a76-51f0826ec6cc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
42942025-02-23T09:19:04.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b7fa21ba-3101-46ff-8a76-51f0826ec6cc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
42952025-02-23T09:19:04.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b7fa21ba-3101-46ff-8a76-51f0826ec6cc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
42962025-02-23T09:19:04.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 188.65728ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42972025-02-23T09:19:04.722ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42982025-02-23T09:19:04.722ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42992025-02-23T09:19:04.722ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 194.690843ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43002025-02-23T09:19:04.738ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43012025-02-23T09:19:04.738ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc40c9b1-e974-4389-8ad4-b1a80d347d02", "content-length": "2", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43022025-02-23T09:19:04.739ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43032025-02-23T09:19:04.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43042025-02-23T09:19:04.742ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 214.489484ms iteration = 22 status = {}
43052025-02-23T09:19:04.742ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 214.544174ms iteration = 22 status = null
43062025-02-23T09:19:04.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43072025-02-23T09:19:04.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43082025-02-23T09:19:04.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43092025-02-23T09:19:04.756ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43102025-02-23T09:19:04.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43112025-02-23T09:19:04.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43122025-02-23T09:19:04.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43132025-02-23T09:19:04.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43142025-02-23T09:19:04.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43152025-02-23T09:19:04.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43162025-02-23T09:19:04.770ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.904986ms iteration = 25 status = {"physical_disks_added":0}
43172025-02-23T09:19:04.775ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43182025-02-23T09:19:04.775ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43192025-02-23T09:19:04.775ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53f0a7e-6e00-4aab-b411-f5c1a8e13301", "content-length": "372", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43202025-02-23T09:19:04.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43212025-02-23T09:19:04.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43222025-02-23T09:19:04.808ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43232025-02-23T09:19:04.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61819e22-5cb3-4530-bcfc-64e7347e930b", "content-length": "691", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43242025-02-23T09:19:04.809ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43252025-02-23T09:19:04.809ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43262025-02-23T09:19:04.809ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43272025-02-23T09:19:04.810ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 282.058178ms iteration = 22 status = {}
43282025-02-23T09:19:04.826ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43292025-02-23T09:19:04.826ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43302025-02-23T09:19:04.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43312025-02-23T09:19:04.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43322025-02-23T09:19:04.837ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
43332025-02-23T09:19:04.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43342025-02-23T09:19:04.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43352025-02-23T09:19:04.847ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43362025-02-23T09:19:04.847ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8caaffa-4a2e-4756-85b0-958ea9ce0d92", "content-length": "134", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43372025-02-23T09:19:04.847ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43382025-02-23T09:19:04.847ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
43392025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43402025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43412025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43422025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43432025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43442025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43452025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43462025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43472025-02-23T09:19:04.848ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
43482025-02-23T09:19:04.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43492025-02-23T09:19:04.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43502025-02-23T09:19:04.849ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43512025-02-23T09:19:04.850ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed8b8582-e514-45ca-bd05-5208346a319c", "content-length": "2", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43522025-02-23T09:19:04.850ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43532025-02-23T09:19:04.850ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb66e6d3-ae33-4fd8-b051-8177e9da196a", "content-length": "52", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43542025-02-23T09:19:04.850ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
43552025-02-23T09:19:04.850ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43562025-02-23T09:19:04.917ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f99beb3a-4416-4863-96d8-93609ebf1295", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43572025-02-23T09:19:04.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43582025-02-23T09:19:04.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43592025-02-23T09:19:04.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43602025-02-23T09:19:04.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43612025-02-23T09:19:04.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43622025-02-23T09:19:04.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43632025-02-23T09:19:04.927ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43642025-02-23T09:19:04.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43652025-02-23T09:19:04.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a2bfa2d3-ab70-400f-8248-fa6a739bf50f", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43662025-02-23T09:19:04.929ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 401.086285ms iteration = 22 status = {}
43672025-02-23T09:19:05.090ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e473baed-a68b-4845-90e8-260cdf3c09f1", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43682025-02-23T09:19:05.090ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
43692025-02-23T09:19:05.090ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43702025-02-23T09:19:05.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "829b4129-07ea-4c1e-89d7-95737a8461b2", "content-length": "682", "date": "Sun, 23 Feb 2025 09:19:04 GMT"} })
43712025-02-23T09:19:05.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43722025-02-23T09:19:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43732025-02-23T09:19:05.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43742025-02-23T09:19:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43752025-02-23T09:19:05.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43762025-02-23T09:19:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43772025-02-23T09:19:05.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43782025-02-23T09:19:05.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43792025-02-23T09:19:05.107ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.764799ms iteration = 22 status = {}
43802025-02-23T09:19:05.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 15945c1d-1379-468a-b22e-f9b0bdaf47f4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43812025-02-23T09:19:05.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 15945c1d-1379-468a-b22e-f9b0bdaf47f4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43822025-02-23T09:19:05.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 15945c1d-1379-468a-b22e-f9b0bdaf47f4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43832025-02-23T09:19:06.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 67759c8e-8595-4ac5-8a3c-2fd70765c947 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
43842025-02-23T09:19:06.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 67759c8e-8595-4ac5-8a3c-2fd70765c947 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
43852025-02-23T09:19:06.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 67759c8e-8595-4ac5-8a3c-2fd70765c947 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
43862025-02-23T09:19:06.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ff2aad19-b82e-4ecb-b992-e0034828a64f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43872025-02-23T09:19:06.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ff2aad19-b82e-4ecb-b992-e0034828a64f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43882025-02-23T09:19:06.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ff2aad19-b82e-4ecb-b992-e0034828a64f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43892025-02-23T09:19:07.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 524 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 46aaca4a-1757-41a2-8688-51b8faa69ef1 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
43902025-02-23T09:19:07.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8a907b73-29c6-4f5e-b7e3-3b03ac0f9e20 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43912025-02-23T09:19:07.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8a907b73-29c6-4f5e-b7e3-3b03ac0f9e20 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43922025-02-23T09:19:07.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8a907b73-29c6-4f5e-b7e3-3b03ac0f9e20 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43932025-02-23T09:19:08.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 625781db-1fc3-49d3-89c2-c9bcd17959b4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43942025-02-23T09:19:08.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 625781db-1fc3-49d3-89c2-c9bcd17959b4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43952025-02-23T09:19:08.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 625781db-1fc3-49d3-89c2-c9bcd17959b4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43962025-02-23T09:19:09.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f17cb5be-4a30-4fdd-bed2-e9cd7f3e3bfc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43972025-02-23T09:19:09.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f17cb5be-4a30-4fdd-bed2-e9cd7f3e3bfc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43982025-02-23T09:19:09.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f17cb5be-4a30-4fdd-bed2-e9cd7f3e3bfc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
43992025-02-23T09:19:10.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 90064171-7bfd-4cda-b687-461e53779372 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44002025-02-23T09:19:10.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 90064171-7bfd-4cda-b687-461e53779372 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44012025-02-23T09:19:10.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 90064171-7bfd-4cda-b687-461e53779372 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44022025-02-23T09:19:11.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e4d6434c-3932-469a-9af6-0ca0ef7a4aa8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44032025-02-23T09:19:11.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e4d6434c-3932-469a-9af6-0ca0ef7a4aa8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44042025-02-23T09:19:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e4d6434c-3932-469a-9af6-0ca0ef7a4aa8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44052025-02-23T09:19:12.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 71e757e4-5831-49e1-91ef-09ff49d4d984 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44062025-02-23T09:19:12.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 71e757e4-5831-49e1-91ef-09ff49d4d984 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44072025-02-23T09:19:12.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 71e757e4-5831-49e1-91ef-09ff49d4d984 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44082025-02-23T09:19:13.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 491ab5a1-af95-4e93-be46-69dc5b9d4cb6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44092025-02-23T09:19:13.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 491ab5a1-af95-4e93-be46-69dc5b9d4cb6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44102025-02-23T09:19:13.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 491ab5a1-af95-4e93-be46-69dc5b9d4cb6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44112025-02-23T09:19:14.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
44122025-02-23T09:19:14.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
44132025-02-23T09:19:14.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44142025-02-23T09:19:14.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44152025-02-23T09:19:14.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44162025-02-23T09:19:14.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44172025-02-23T09:19:14.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44182025-02-23T09:19:14.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44192025-02-23T09:19:14.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44202025-02-23T09:19:14.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44212025-02-23T09:19:14.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44222025-02-23T09:19:14.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44232025-02-23T09:19:14.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.70643ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44242025-02-23T09:19:14.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44252025-02-23T09:19:14.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44262025-02-23T09:19:14.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44272025-02-23T09:19:14.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
44282025-02-23T09:19:14.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44292025-02-23T09:19:14.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44302025-02-23T09:19:14.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
44312025-02-23T09:19:14.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.32732ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
44322025-02-23T09:19:14.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 47d44cb8-5012-4c80-b275-554e99ad5598 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44332025-02-23T09:19:14.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 47d44cb8-5012-4c80-b275-554e99ad5598 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44342025-02-23T09:19:14.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 47d44cb8-5012-4c80-b275-554e99ad5598 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44352025-02-23T09:19:15.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a6813b07-a046-412d-bff7-6ce807657821 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44362025-02-23T09:19:15.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a6813b07-a046-412d-bff7-6ce807657821 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44372025-02-23T09:19:15.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a6813b07-a046-412d-bff7-6ce807657821 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44382025-02-23T09:19:16.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4ce060f3-0af4-45a8-8aa8-c7373e99357b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44392025-02-23T09:19:16.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4ce060f3-0af4-45a8-8aa8-c7373e99357b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44402025-02-23T09:19:16.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4ce060f3-0af4-45a8-8aa8-c7373e99357b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44412025-02-23T09:19:17.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = eb6e833f-1fb3-4401-a3db-29e350f3e13f response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
44422025-02-23T09:19:17.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b665df7-49f6-45c6-b1e6-a8eede567b8f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44432025-02-23T09:19:17.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b665df7-49f6-45c6-b1e6-a8eede567b8f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44442025-02-23T09:19:17.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3b665df7-49f6-45c6-b1e6-a8eede567b8f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44452025-02-23T09:19:19.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1bc81419-c098-46b0-bf6c-9debded9e555 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44462025-02-23T09:19:19.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1bc81419-c098-46b0-bf6c-9debded9e555 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44472025-02-23T09:19:19.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1bc81419-c098-46b0-bf6c-9debded9e555 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44482025-02-23T09:19:20.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3383d306-39e2-42d9-85cb-3c80c13537f8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44492025-02-23T09:19:20.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3383d306-39e2-42d9-85cb-3c80c13537f8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44502025-02-23T09:19:20.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3383d306-39e2-42d9-85cb-3c80c13537f8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44512025-02-23T09:19:21.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8b1e42c3-c660-4f7c-bb36-07e4b5c4afcb roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44522025-02-23T09:19:21.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8b1e42c3-c660-4f7c-bb36-07e4b5c4afcb resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44532025-02-23T09:19:21.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8b1e42c3-c660-4f7c-bb36-07e4b5c4afcb response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44542025-02-23T09:19:22.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 69aa12c0-5b56-4a28-9e19-b0305349cd3e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44552025-02-23T09:19:22.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 69aa12c0-5b56-4a28-9e19-b0305349cd3e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44562025-02-23T09:19:22.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 69aa12c0-5b56-4a28-9e19-b0305349cd3e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44572025-02-23T09:19:23.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d5c9f666-1fd5-4fcc-85a5-b24aee154010 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44582025-02-23T09:19:23.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d5c9f666-1fd5-4fcc-85a5-b24aee154010 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44592025-02-23T09:19:23.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d5c9f666-1fd5-4fcc-85a5-b24aee154010 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44602025-02-23T09:19:24.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b35256e2-6707-42b1-b4f6-8ef5d10402a3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44612025-02-23T09:19:24.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b35256e2-6707-42b1-b4f6-8ef5d10402a3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44622025-02-23T09:19:24.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b35256e2-6707-42b1-b4f6-8ef5d10402a3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44632025-02-23T09:19:24.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
44642025-02-23T09:19:24.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
44652025-02-23T09:19:24.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44662025-02-23T09:19:24.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44672025-02-23T09:19:24.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44682025-02-23T09:19:24.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44692025-02-23T09:19:24.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44702025-02-23T09:19:24.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44712025-02-23T09:19:24.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44722025-02-23T09:19:24.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44732025-02-23T09:19:24.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44742025-02-23T09:19:24.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44752025-02-23T09:19:24.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762025-02-23T09:19:24.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44772025-02-23T09:19:24.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-02-23T09:19:24.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.343304ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44792025-02-23T09:19:24.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
44802025-02-23T09:19:24.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44812025-02-23T09:19:24.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44822025-02-23T09:19:24.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
44832025-02-23T09:19:24.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.898558ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
44842025-02-23T09:19:25.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1dd2f522-179e-48f9-8e83-11a864b5c33d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44852025-02-23T09:19:25.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1dd2f522-179e-48f9-8e83-11a864b5c33d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44862025-02-23T09:19:25.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1dd2f522-179e-48f9-8e83-11a864b5c33d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44872025-02-23T09:19:26.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = deecd3aa-d397-4201-ae5d-8cb6c8e4a4a0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44882025-02-23T09:19:26.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = deecd3aa-d397-4201-ae5d-8cb6c8e4a4a0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44892025-02-23T09:19:26.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = deecd3aa-d397-4201-ae5d-8cb6c8e4a4a0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44902025-02-23T09:19:27.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d33fd908-2626-490e-a364-c2b0c317ec18 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44912025-02-23T09:19:27.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d33fd908-2626-490e-a364-c2b0c317ec18 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44922025-02-23T09:19:27.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d33fd908-2626-490e-a364-c2b0c317ec18 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44932025-02-23T09:19:27.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 659 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 9dc5d479-367a-4b54-949d-0e4affeaa2a2 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
44942025-02-23T09:19:28.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fe5472f6-adb0-4607-89aa-0e2cb20924af roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44952025-02-23T09:19:28.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fe5472f6-adb0-4607-89aa-0e2cb20924af resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44962025-02-23T09:19:28.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fe5472f6-adb0-4607-89aa-0e2cb20924af response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44972025-02-23T09:19:29.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d146fb4-0f75-4349-9396-3f6e28c92090 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44982025-02-23T09:19:29.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d146fb4-0f75-4349-9396-3f6e28c92090 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
44992025-02-23T09:19:29.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d146fb4-0f75-4349-9396-3f6e28c92090 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45002025-02-23T09:19:30.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a11a1227-c403-4388-b5f0-922d93857eed roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45012025-02-23T09:19:30.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a11a1227-c403-4388-b5f0-922d93857eed resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45022025-02-23T09:19:30.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a11a1227-c403-4388-b5f0-922d93857eed response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45032025-02-23T09:19:31.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 76a7d2f9-561f-409f-96ab-cb80c24c3da8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45042025-02-23T09:19:31.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 76a7d2f9-561f-409f-96ab-cb80c24c3da8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45052025-02-23T09:19:31.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 76a7d2f9-561f-409f-96ab-cb80c24c3da8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45062025-02-23T09:19:31.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d252aa5d-43fb-4502-afd5-18dbfacdbd2d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
45072025-02-23T09:19:31.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d252aa5d-43fb-4502-afd5-18dbfacdbd2d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
45082025-02-23T09:19:31.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d252aa5d-43fb-4502-afd5-18dbfacdbd2d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
45092025-02-23T09:19:31.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 87a8d96b-41d0-4455-aa68-a0c30892b84f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/14?limit=100
45102025-02-23T09:19:31.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 87a8d96b-41d0-4455-aa68-a0c30892b84f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/14?limit=100
45112025-02-23T09:19:31.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 87a8d96b-41d0-4455-aa68-a0c30892b84f response_code = 200 uri = /nat/ipv4/changeset/14?limit=100
45122025-02-23T09:19:32.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 18de3f83-bdbe-42fa-a681-15c14ba653ab roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
45132025-02-23T09:19:32.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 18de3f83-bdbe-42fa-a681-15c14ba653ab resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
45142025-02-23T09:19:32.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 18de3f83-bdbe-42fa-a681-15c14ba653ab response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
45152025-02-23T09:19:32.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = eb1dc67a-da6b-4b3c-adaf-0629fe849951 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
45162025-02-23T09:19:32.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = eb1dc67a-da6b-4b3c-adaf-0629fe849951 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
45172025-02-23T09:19:32.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = eb1dc67a-da6b-4b3c-adaf-0629fe849951 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
45182025-02-23T09:19:32.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 16e904e3-1200-412e-a28a-fbf149733698 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45192025-02-23T09:19:32.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 16e904e3-1200-412e-a28a-fbf149733698 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45202025-02-23T09:19:32.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 16e904e3-1200-412e-a28a-fbf149733698 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45212025-02-23T09:19:33.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d55e3a13-3c26-41f7-99c7-c11aa69d65c7 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45222025-02-23T09:19:33.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d55e3a13-3c26-41f7-99c7-c11aa69d65c7 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45232025-02-23T09:19:33.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d55e3a13-3c26-41f7-99c7-c11aa69d65c7 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45242025-02-23T09:19:34.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8a67e16e-c382-4421-949e-c23c3b6afc08 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45252025-02-23T09:19:34.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8a67e16e-c382-4421-949e-c23c3b6afc08 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45262025-02-23T09:19:34.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8a67e16e-c382-4421-949e-c23c3b6afc08 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
45272025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
45282025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
45292025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
45302025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45312025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45322025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
45332025-02-23T09:19:34.528ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45342025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45352025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
45362025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
45372025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
45382025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45392025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
45402025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45412025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
45422025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
45432025-02-23T09:19:34.528ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45442025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
45452025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45462025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
45472025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45482025-02-23T09:19:34.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
45492025-02-23T09:19:34.529ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
45502025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.6\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
45512025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
45522025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
45532025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45542025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45552025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
45562025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45572025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
45582025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45592025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
45602025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45612025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45622025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
45632025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
45642025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45652025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45662025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
45672025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45682025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
45692025-02-23T09:19:34.529ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:09:34.529089625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45702025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45712025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
45722025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45732025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
45742025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45752025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45762025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
45772025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
45782025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
45792025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
45802025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45812025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45822025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45832025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
45842025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
45852025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45862025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45872025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
45882025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
45892025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45902025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45912025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
45922025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45932025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
45942025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45952025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45962025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45972025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45982025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45992025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46002025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46012025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46022025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46032025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46042025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46052025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46062025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46072025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46082025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46092025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46102025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
46112025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46122025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46132025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46142025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46152025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46162025-02-23T09:19:34.529ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 36190, tv_nsec: 228572457 } })
46172025-02-23T09:19:34.529ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 36190, tv_nsec: 228584367 } })
46182025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46192025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46202025-02-23T09:19:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46212025-02-23T09:19:34.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46222025-02-23T09:19:34.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
46232025-02-23T09:19:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.585199ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46242025-02-23T09:19:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.303924ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
46252025-02-23T09:19:34.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-02-23T09:19:34.534ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.527833ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46272025-02-23T09:19:34.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46282025-02-23T09:19:34.537ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 8.265255ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
46292025-02-23T09:19:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46302025-02-23T09:19:34.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46312025-02-23T09:19:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46322025-02-23T09:19:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46332025-02-23T09:19:34.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46342025-02-23T09:19:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46352025-02-23T09:19:34.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46362025-02-23T09:19:34.544ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.947868ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
46372025-02-23T09:19:34.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46382025-02-23T09:19:34.547ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:09:34.529089625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46392025-02-23T09:19:34.547ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.509937ms iteration = 12 status = {"expiration":"2025-02-23T09:09:34.529089625Z","pruned":[]}
46402025-02-23T09:19:34.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46412025-02-23T09:19:34.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36190, tv_nsec: 246960551 } })
46422025-02-23T09:19:34.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46432025-02-23T09:19:34.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
46442025-02-23T09:19:34.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36190, tv_nsec: 247542592 } })
46452025-02-23T09:19:34.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
46462025-02-23T09:19:34.552ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46472025-02-23T09:19:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46482025-02-23T09:19:34.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46492025-02-23T09:19:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46502025-02-23T09:19:34.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46512025-02-23T09:19:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46522025-02-23T09:19:34.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46532025-02-23T09:19:34.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46542025-02-23T09:19:34.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46552025-02-23T09:19:34.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46562025-02-23T09:19:34.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46572025-02-23T09:19:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46582025-02-23T09:19:34.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46592025-02-23T09:19:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46602025-02-23T09:19:34.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46612025-02-23T09:19:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46622025-02-23T09:19:34.627ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46632025-02-23T09:19:34.627ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46642025-02-23T09:19:34.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46652025-02-23T09:19:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46662025-02-23T09:19:34.628ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672025-02-23T09:19:34.629ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46682025-02-23T09:19:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46692025-02-23T09:19:34.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46702025-02-23T09:19:34.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46712025-02-23T09:19:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46722025-02-23T09:19:34.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46732025-02-23T09:19:34.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46742025-02-23T09:19:34.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46752025-02-23T09:19:34.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46762025-02-23T09:19:34.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46772025-02-23T09:19:34.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46782025-02-23T09:19:34.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 106.689296ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
46792025-02-23T09:19:34.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46802025-02-23T09:19:34.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46812025-02-23T09:19:34.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46822025-02-23T09:19:34.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46832025-02-23T09:19:34.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46842025-02-23T09:19:34.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46852025-02-23T09:19:34.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46862025-02-23T09:19:34.641ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46872025-02-23T09:19:34.641ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46882025-02-23T09:19:34.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46892025-02-23T09:19:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46902025-02-23T09:19:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
46912025-02-23T09:19:34.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46922025-02-23T09:19:34.642ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46932025-02-23T09:19:34.642ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46942025-02-23T09:19:34.642ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 113.416252ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46952025-02-23T09:19:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46962025-02-23T09:19:34.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46972025-02-23T09:19:34.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46982025-02-23T09:19:34.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46992025-02-23T09:19:34.647ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47002025-02-23T09:19:34.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47012025-02-23T09:19:34.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47022025-02-23T09:19:34.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47032025-02-23T09:19:34.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47042025-02-23T09:19:34.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 120.535735ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
47052025-02-23T09:19:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47062025-02-23T09:19:34.651ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47072025-02-23T09:19:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47082025-02-23T09:19:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47092025-02-23T09:19:34.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47102025-02-23T09:19:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47112025-02-23T09:19:34.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 126.559368ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47122025-02-23T09:19:34.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47132025-02-23T09:19:34.661ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36190, tv_nsec: 359753261 } })
47142025-02-23T09:19:34.661ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
47152025-02-23T09:19:34.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47162025-02-23T09:19:34.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47172025-02-23T09:19:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47182025-02-23T09:19:34.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47192025-02-23T09:19:34.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47202025-02-23T09:19:34.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47212025-02-23T09:19:34.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47222025-02-23T09:19:34.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47232025-02-23T09:19:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47242025-02-23T09:19:34.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47252025-02-23T09:19:34.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47262025-02-23T09:19:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47272025-02-23T09:19:34.682ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47282025-02-23T09:19:34.682ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47292025-02-23T09:19:34.682ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47302025-02-23T09:19:34.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47312025-02-23T09:19:34.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47322025-02-23T09:19:34.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47332025-02-23T09:19:34.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 159.25118ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47342025-02-23T09:19:34.692ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47352025-02-23T09:19:34.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47362025-02-23T09:19:34.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47372025-02-23T09:19:34.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47382025-02-23T09:19:34.708ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
47392025-02-23T09:19:34.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 179.631511ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
47402025-02-23T09:19:34.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47412025-02-23T09:19:34.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47422025-02-23T09:19:34.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 182.256381ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47432025-02-23T09:19:34.718ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47442025-02-23T09:19:34.718ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47452025-02-23T09:19:34.718ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 189.505616ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47462025-02-23T09:19:34.718ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47472025-02-23T09:19:34.718ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47482025-02-23T09:19:34.718ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 189.71829ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47492025-02-23T09:19:34.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
47502025-02-23T09:19:34.719ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47512025-02-23T09:19:34.719ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e238ef8-ad1f-451c-9ff8-6306cc0dd7f2", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
47522025-02-23T09:19:34.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47532025-02-23T09:19:34.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47542025-02-23T09:19:34.722ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47552025-02-23T09:19:34.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47562025-02-23T09:19:34.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47572025-02-23T09:19:34.746ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47582025-02-23T09:19:34.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47592025-02-23T09:19:34.747ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47602025-02-23T09:19:34.747ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47612025-02-23T09:19:34.747ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47622025-02-23T09:19:34.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47632025-02-23T09:19:34.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47642025-02-23T09:19:34.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47652025-02-23T09:19:34.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47662025-02-23T09:19:34.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47672025-02-23T09:19:34.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47682025-02-23T09:19:34.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47692025-02-23T09:19:34.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
47702025-02-23T09:19:34.766ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47712025-02-23T09:19:34.766ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52534d3b-feb6-442f-8be4-0df812db41e4", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
47722025-02-23T09:19:34.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47732025-02-23T09:19:34.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47742025-02-23T09:19:34.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47752025-02-23T09:19:34.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47762025-02-23T09:19:34.797ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 268.590897ms iteration = 26 status = {"physical_disks_added":0}
47772025-02-23T09:19:34.854ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
47782025-02-23T09:19:34.854ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 325.382859ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47792025-02-23T09:19:34.857ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47802025-02-23T09:19:34.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state
47812025-02-23T09:19:34.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47822025-02-23T09:19:34.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47832025-02-23T09:19:34.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47842025-02-23T09:19:34.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47852025-02-23T09:19:34.911ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47862025-02-23T09:19:34.911ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6359ea2b-c1a8-43aa-97e3-0b6c91fa4a12", "content-length": "2", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
47872025-02-23T09:19:34.914ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47882025-02-23T09:19:34.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47892025-02-23T09:19:34.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
47902025-02-23T09:19:34.940ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47912025-02-23T09:19:34.940ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f20e72d-bd93-44e4-a876-0031a6424e7d", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
47922025-02-23T09:19:34.940ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47932025-02-23T09:19:34.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
47942025-02-23T09:19:34.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47952025-02-23T09:19:34.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 417.40379ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47962025-02-23T09:19:34.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
47972025-02-23T09:19:34.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47982025-02-23T09:19:34.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47992025-02-23T09:19:34.950ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48002025-02-23T09:19:34.950ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48012025-02-23T09:19:34.951ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fba16df0-81c8-4d33-a6b4-e42670d2fe25", "content-length": "523", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
48022025-02-23T09:19:34.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48032025-02-23T09:19:34.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48042025-02-23T09:19:34.953ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48052025-02-23T09:19:34.953ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "80fb53e1-2ec2-45fe-8ded-08e69c0a75cb", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48062025-02-23T09:19:34.953ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48072025-02-23T09:19:34.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48082025-02-23T09:19:34.954ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 425.114375ms iteration = 23 status = {}
48092025-02-23T09:19:34.954ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
48102025-02-23T09:19:34.954ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 425.352929ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
48112025-02-23T09:19:34.956ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bbf523ef-f2f0-4dae-af50-91f4d62320dd", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48122025-02-23T09:19:34.956ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48132025-02-23T09:19:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 427.560211ms iteration = 23 status = null
48142025-02-23T09:19:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 427.338237ms iteration = 23 status = 0
48152025-02-23T09:19:34.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48162025-02-23T09:19:34.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48172025-02-23T09:19:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48182025-02-23T09:19:34.958ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48192025-02-23T09:19:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 429.972116ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48202025-02-23T09:19:34.976ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
48212025-02-23T09:19:34.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48222025-02-23T09:19:34.976ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2aafb01f-6b77-4109-8792-79dd0c221417", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
48232025-02-23T09:19:34.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48242025-02-23T09:19:34.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48252025-02-23T09:19:34.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48262025-02-23T09:19:34.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48272025-02-23T09:19:34.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48282025-02-23T09:19:34.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48292025-02-23T09:19:34.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48302025-02-23T09:19:34.986ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48312025-02-23T09:19:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48322025-02-23T09:19:34.986ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d4ef645d-bb70-44b3-82ac-580f96c80b37", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48332025-02-23T09:19:34.986ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48342025-02-23T09:19:34.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9fef2ba1-8356-4cb0-a779-50fb02cfe5f0", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48352025-02-23T09:19:34.989ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48362025-02-23T09:19:34.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48372025-02-23T09:19:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48382025-02-23T09:19:34.992ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ccafe645-51e7-4ed2-9292-152d14758391", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48392025-02-23T09:19:34.992ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48402025-02-23T09:19:34.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48412025-02-23T09:19:34.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422025-02-23T09:19:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48432025-02-23T09:19:34.994ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48442025-02-23T09:19:34.994ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 465.827166ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48452025-02-23T09:19:34.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48462025-02-23T09:19:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48472025-02-23T09:19:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48482025-02-23T09:19:34.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48492025-02-23T09:19:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48502025-02-23T09:19:34.998ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
48512025-02-23T09:19:34.998ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
48522025-02-23T09:19:34.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48532025-02-23T09:19:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48542025-02-23T09:19:34.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48552025-02-23T09:19:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48562025-02-23T09:19:35.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48572025-02-23T09:19:35.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48582025-02-23T09:19:35.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48592025-02-23T09:19:35.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48602025-02-23T09:19:35.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48612025-02-23T09:19:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48622025-02-23T09:19:35.012ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
48632025-02-23T09:19:35.012ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 483.417246ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48642025-02-23T09:19:35.037ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48652025-02-23T09:19:35.037ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
48662025-02-23T09:19:35.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48672025-02-23T09:19:35.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48682025-02-23T09:19:35.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692025-02-23T09:19:35.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48702025-02-23T09:19:35.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48712025-02-23T09:19:35.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48722025-02-23T09:19:35.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48732025-02-23T09:19:35.045ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
48742025-02-23T09:19:35.045ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48752025-02-23T09:19:35.045ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
48762025-02-23T09:19:35.045ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 516.631137ms iteration = 12 status = {"generation":2}
48772025-02-23T09:19:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48782025-02-23T09:19:35.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48792025-02-23T09:19:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48802025-02-23T09:19:35.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48812025-02-23T09:19:35.048ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
48822025-02-23T09:19:35.048ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48832025-02-23T09:19:35.048ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
48842025-02-23T09:19:35.049ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 519.786847ms iteration = 12 status = {"generation":1}
48852025-02-23T09:19:35.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48862025-02-23T09:19:35.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48872025-02-23T09:19:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48882025-02-23T09:19:35.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892025-02-23T09:19:35.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48902025-02-23T09:19:35.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48912025-02-23T09:19:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48922025-02-23T09:19:35.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48932025-02-23T09:19:35.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48942025-02-23T09:19:35.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48952025-02-23T09:19:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48962025-02-23T09:19:35.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48972025-02-23T09:19:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48982025-02-23T09:19:35.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48992025-02-23T09:19:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49002025-02-23T09:19:35.092ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
49012025-02-23T09:19:35.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49022025-02-23T09:19:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49032025-02-23T09:19:35.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49042025-02-23T09:19:35.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d86af5e5-a547-4143-9d54-617030c29ec0", "content-length": "134", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
49052025-02-23T09:19:35.105ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49062025-02-23T09:19:35.105ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
49072025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49082025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49092025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49102025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49112025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49122025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49132025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49142025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49152025-02-23T09:19:35.106ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
49162025-02-23T09:19:35.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49172025-02-23T09:19:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49182025-02-23T09:19:35.109ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49192025-02-23T09:19:35.109ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a366ad9-b2e0-49fe-a5ed-0a946b159223", "content-length": "2", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
49202025-02-23T09:19:35.109ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49212025-02-23T09:19:35.109ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "36716ebe-8437-4ed8-8894-6a636152091d", "content-length": "52", "date": "Sun, 23 Feb 2025 09:19:35 GMT"} })
49222025-02-23T09:19:35.109ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
49232025-02-23T09:19:35.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49242025-02-23T09:19:35.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49252025-02-23T09:19:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: 9a116fa5-3203-43ae-8d4f-3c20653c28f5, lookup_type: ById(9a116fa5-3203-43ae-8d4f-3c20653c28f5) }, key: dcae4495-9e46-4681-9480-edd6fca66881, lookup_type: ById(dcae4495-9e46-4681-9480-edd6fca66881) } result = Ok(())
49262025-02-23T09:19:35.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49272025-02-23T09:19:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49282025-02-23T09:19:35.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49292025-02-23T09:19:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49302025-02-23T09:19:35.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49312025-02-23T09:19:35.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49322025-02-23T09:19:35.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332025-02-23T09:19:35.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: 9a116fa5-3203-43ae-8d4f-3c20653c28f5, lookup_type: ById(9a116fa5-3203-43ae-8d4f-3c20653c28f5) }, key: dcae4495-9e46-4681-9480-edd6fca66881, lookup_type: ById(dcae4495-9e46-4681-9480-edd6fca66881) } result = Ok(())
49342025-02-23T09:19:35.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49352025-02-23T09:19:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49362025-02-23T09:19:35.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49372025-02-23T09:19:35.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49382025-02-23T09:19:35.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49392025-02-23T09:19:35.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49402025-02-23T09:19:35.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49412025-02-23T09:19:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49422025-02-23T09:19:35.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49432025-02-23T09:19:35.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49442025-02-23T09:19:35.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49452025-02-23T09:19:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49462025-02-23T09:19:35.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49472025-02-23T09:19:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49482025-02-23T09:19:35.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49492025-02-23T09:19:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49502025-02-23T09:19:35.182ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49512025-02-23T09:19:35.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49522025-02-23T09:19:35.184ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc05dd12-bb18-4539-9ed2-89eafd0e871e", "content-length": "810", "date": "Sun, 23 Feb 2025 09:19:35 GMT"} })
49532025-02-23T09:19:35.184ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(3629862) }} sled = buskin
49542025-02-23T09:19:35.184ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49552025-02-23T09:19:35.184ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49562025-02-23T09:19:35.185ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 656.392412ms iteration = 23 status = {}
49572025-02-23T09:19:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: 9a116fa5-3203-43ae-8d4f-3c20653c28f5, lookup_type: ById(9a116fa5-3203-43ae-8d4f-3c20653c28f5) }, key: f39dacec-78e1-4939-8e2a-2f1588e77f1c, lookup_type: ById(f39dacec-78e1-4939-8e2a-2f1588e77f1c) } result = Ok(())
49582025-02-23T09:19:35.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49592025-02-23T09:19:35.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49602025-02-23T09:19:35.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49612025-02-23T09:19:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49622025-02-23T09:19:35.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49632025-02-23T09:19:35.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49642025-02-23T09:19:35.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49652025-02-23T09:19:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49662025-02-23T09:19:35.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49672025-02-23T09:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49682025-02-23T09:19:35.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49692025-02-23T09:19:35.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49702025-02-23T09:19:35.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49712025-02-23T09:19:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49722025-02-23T09:19:35.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49732025-02-23T09:19:35.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: 9a116fa5-3203-43ae-8d4f-3c20653c28f5, lookup_type: ById(9a116fa5-3203-43ae-8d4f-3c20653c28f5) }, key: f39dacec-78e1-4939-8e2a-2f1588e77f1c, lookup_type: ByName("default") } result = Ok(())
49742025-02-23T09:19:35.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49752025-02-23T09:19:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49762025-02-23T09:19:35.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49772025-02-23T09:19:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49782025-02-23T09:19:35.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49792025-02-23T09:19:35.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49802025-02-23T09:19:35.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49812025-02-23T09:19:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49822025-02-23T09:19:35.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49832025-02-23T09:19:35.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49842025-02-23T09:19:35.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49852025-02-23T09:19:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49862025-02-23T09:19:35.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49872025-02-23T09:19:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49882025-02-23T09:19:35.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49892025-02-23T09:19:35.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: 9a116fa5-3203-43ae-8d4f-3c20653c28f5, lookup_type: ById(9a116fa5-3203-43ae-8d4f-3c20653c28f5) }, key: e62946f6-89b3-40be-a86f-d8150af7572b, lookup_type: ByName("default") } result = Ok(())
49902025-02-23T09:19:35.221ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49912025-02-23T09:19:35.221ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49922025-02-23T09:19:35.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "714419a1-e549-4cff-a0b8-07672ceb7ee7", "date": "Sun, 23 Feb 2025 09:19:35 GMT"} })
49932025-02-23T09:19:35.225ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 696.654836ms iteration = 23 status = {}
49942025-02-23T09:19:35.280ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "aea2c15d-f4f7-4116-9791-48da29e3a76a", "date": "Sun, 23 Feb 2025 09:19:35 GMT"} })
49952025-02-23T09:19:35.280ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
49962025-02-23T09:19:35.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49972025-02-23T09:19:35.284ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5f1951-2688-4c7b-b6ab-d3cbe45ffa79", "content-length": "682", "date": "Sun, 23 Feb 2025 09:19:34 GMT"} })
49982025-02-23T09:19:35.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49992025-02-23T09:19:35.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50002025-02-23T09:19:35.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50012025-02-23T09:19:35.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50022025-02-23T09:19:35.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50032025-02-23T09:19:35.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50042025-02-23T09:19:35.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50052025-02-23T09:19:35.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50062025-02-23T09:19:35.300ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.617639ms iteration = 23 status = {}
50072025-02-23T09:19:35.375ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
50082025-02-23T09:19:35.375ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
50092025-02-23T09:19:35.405ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
50102025-02-23T09:19:35.405ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:50593
50112025-02-23T09:19:35.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50593 req_id = 6cad71ab-8b36-45f0-9ef2-f92c3d6bd682 roles = RoleSet { roles: {} } uri = /metrics/producers
50122025-02-23T09:19:35.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50593 req_id = 6cad71ab-8b36-45f0-9ef2-f92c3d6bd682 resource = Database result = Ok(()) uri = /metrics/producers
50132025-02-23T09:19:35.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 32e41aac-823a-4f57-be76-70260a5536e1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50142025-02-23T09:19:35.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 32e41aac-823a-4f57-be76-70260a5536e1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50152025-02-23T09:19:35.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 32e41aac-823a-4f57-be76-70260a5536e1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50162025-02-23T09:19:35.449ZINFOnexus: assigned collector to new producer collector_id = de6ca227-55b1-420b-b454-b4242aff85c9 file = nexus/src/app/oximeter.rs:76 producer_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
50172025-02-23T09:19:35.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43311 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50593 req_id = 6cad71ab-8b36-45f0-9ef2-f92c3d6bd682 response_code = 201 uri = /metrics/producers
50182025-02-23T09:19:35.449ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6cad71ab-8b36-45f0-9ef2-f92c3d6bd682", "content-length": "41", "date": "Sun, 23 Feb 2025 09:19:35 GMT"} })
50192025-02-23T09:19:35.451ZDEBGnexus (producer-registration-task): registered with nexus successfully
50202025-02-23T09:19:35.451ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
50212025-02-23T09:19:36.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 59bace89-9ba1-479d-990d-0167dbd5db60 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50222025-02-23T09:19:36.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 59bace89-9ba1-479d-990d-0167dbd5db60 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50232025-02-23T09:19:36.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 59bace89-9ba1-479d-990d-0167dbd5db60 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50242025-02-23T09:19:37.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 3736df79-ac1a-4cd0-b42c-89363df5e9ca response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
50252025-02-23T09:19:37.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d0487608-7742-4081-bfe7-0d7dd21da65d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50262025-02-23T09:19:37.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d0487608-7742-4081-bfe7-0d7dd21da65d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50272025-02-23T09:19:37.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d0487608-7742-4081-bfe7-0d7dd21da65d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50282025-02-23T09:19:38.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 705205dd-d0a4-44f8-9bb6-dc0fb9210617 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50292025-02-23T09:19:38.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 705205dd-d0a4-44f8-9bb6-dc0fb9210617 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50302025-02-23T09:19:38.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 705205dd-d0a4-44f8-9bb6-dc0fb9210617 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50312025-02-23T09:19:38.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4c98ea8-3003-492c-b3cc-bcc8222527ef", "content-length": "131", "date": "Sun, 23 Feb 2025 09:19:38 GMT"} })
50322025-02-23T09:19:38.839ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-23T09:19:30.886723491Z }, migration_in: None, migration_out: None } vmm_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
50332025-02-23T09:19:38.839ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2078 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b vmm_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-23T09:19:30.886723491Z }
50342025-02-23T09:19:38.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff roles = RoleSet { roles: {} } sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b vmm_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
50352025-02-23T09:19:38.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff resource = Database result = Ok(()) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b vmm_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
50362025-02-23T09:19:38.847ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03832223-c3ba-4c8b-9c94-6cc909b4fb57 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-23T09:19:38.829609465Z }
50372025-02-23T09:19:38.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03832223-c3ba-4c8b-9c94-6cc909b4fb57 roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50382025-02-23T09:19:38.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03832223-c3ba-4c8b-9c94-6cc909b4fb57 resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50392025-02-23T09:19:38.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 34104 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03832223-c3ba-4c8b-9c94-6cc909b4fb57 response_code = 204 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50402025-02-23T09:19:38.893ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
50412025-02-23T09:19:38.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 4.367003985s iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
50422025-02-23T09:19:38.911ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6d97378e-e9a3-4eaa-b73a-c5e91c539623 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-23T09:19:38.910809694Z }
50432025-02-23T09:19:38.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6d97378e-e9a3-4eaa-b73a-c5e91c539623 roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50442025-02-23T09:19:38.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6d97378e-e9a3-4eaa-b73a-c5e91c539623 resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50452025-02-23T09:19:38.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 34961 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6d97378e-e9a3-4eaa-b73a-c5e91c539623 response_code = 204 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50462025-02-23T09:19:39.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 12208b3e-d062-4226-b4d9-7b80dac76608 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50472025-02-23T09:19:39.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 12208b3e-d062-4226-b4d9-7b80dac76608 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50482025-02-23T09:19:39.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 12208b3e-d062-4226-b4d9-7b80dac76608 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50492025-02-23T09:19:40.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cda8c968-e6d0-4905-ab14-d5c21202d812 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50502025-02-23T09:19:40.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cda8c968-e6d0-4905-ab14-d5c21202d812 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50512025-02-23T09:19:40.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cda8c968-e6d0-4905-ab14-d5c21202d812 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50522025-02-23T09:19:41.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0add00f9-b364-4e33-a356-e8ee09fec1c1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50532025-02-23T09:19:41.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0add00f9-b364-4e33-a356-e8ee09fec1c1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50542025-02-23T09:19:41.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0add00f9-b364-4e33-a356-e8ee09fec1c1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50552025-02-23T09:19:42.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c8f528cc-7b6f-4181-b559-1aa2d0517561 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50562025-02-23T09:19:42.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c8f528cc-7b6f-4181-b559-1aa2d0517561 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50572025-02-23T09:19:42.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c8f528cc-7b6f-4181-b559-1aa2d0517561 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50582025-02-23T09:19:43.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 08d97972-fe24-487b-a3b2-2eff0f153892 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50592025-02-23T09:19:43.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 08d97972-fe24-487b-a3b2-2eff0f153892 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50602025-02-23T09:19:43.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 08d97972-fe24-487b-a3b2-2eff0f153892 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50612025-02-23T09:19:44.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
50622025-02-23T09:19:44.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
50632025-02-23T09:19:44.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50642025-02-23T09:19:44.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50652025-02-23T09:19:44.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50662025-02-23T09:19:44.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50672025-02-23T09:19:44.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50682025-02-23T09:19:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50692025-02-23T09:19:44.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50702025-02-23T09:19:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50712025-02-23T09:19:44.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50722025-02-23T09:19:44.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50732025-02-23T09:19:44.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50742025-02-23T09:19:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
50752025-02-23T09:19:44.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50762025-02-23T09:19:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50772025-02-23T09:19:44.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
50782025-02-23T09:19:44.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.087543ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
50792025-02-23T09:19:44.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50802025-02-23T09:19:44.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50812025-02-23T09:19:44.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.7216ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50822025-02-23T09:19:44.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a7969b9c-26a2-46bd-bd78-5016ebb70d76 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50832025-02-23T09:19:44.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a7969b9c-26a2-46bd-bd78-5016ebb70d76 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50842025-02-23T09:19:44.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a7969b9c-26a2-46bd-bd78-5016ebb70d76 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50852025-02-23T09:19:45.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d012a602-f802-45c5-83e3-d95f582e48c4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50862025-02-23T09:19:45.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d012a602-f802-45c5-83e3-d95f582e48c4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50872025-02-23T09:19:45.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d012a602-f802-45c5-83e3-d95f582e48c4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50882025-02-23T09:19:46.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eada7d41-85a8-470c-98e3-ecb0803b5026 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50892025-02-23T09:19:46.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eada7d41-85a8-470c-98e3-ecb0803b5026 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50902025-02-23T09:19:46.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eada7d41-85a8-470c-98e3-ecb0803b5026 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50912025-02-23T09:19:47.287ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2974 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = ff3ee631-f123-46f9-a96a-87002187419e response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
50922025-02-23T09:19:47.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = db262bbd-04ea-4326-95a4-9c08ae7c3165 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50932025-02-23T09:19:47.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = db262bbd-04ea-4326-95a4-9c08ae7c3165 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50942025-02-23T09:19:47.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = db262bbd-04ea-4326-95a4-9c08ae7c3165 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
50952025-02-23T09:19:48.622ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80d5692e-f58f-4ad2-a18e-c918b3071a7e uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-23T09:19:48.622383693Z }
50962025-02-23T09:19:48.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80d5692e-f58f-4ad2-a18e-c918b3071a7e roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50972025-02-23T09:19:48.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80d5692e-f58f-4ad2-a18e-c918b3071a7e resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50982025-02-23T09:19:48.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44362 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 80d5692e-f58f-4ad2-a18e-c918b3071a7e response_code = 204 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
50992025-02-23T09:19:48.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e8bcff07-c474-4e9e-99aa-9f2d081d353a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51002025-02-23T09:19:48.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e8bcff07-c474-4e9e-99aa-9f2d081d353a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51012025-02-23T09:19:48.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e8bcff07-c474-4e9e-99aa-9f2d081d353a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51022025-02-23T09:19:49.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = f28ecc8d-0d8a-4cb0-8dc1-679f99d8571f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/14?limit=100
51032025-02-23T09:19:49.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = f28ecc8d-0d8a-4cb0-8dc1-679f99d8571f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/14?limit=100
51042025-02-23T09:19:49.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = f28ecc8d-0d8a-4cb0-8dc1-679f99d8571f response_code = 200 uri = /nat/ipv4/changeset/14?limit=100
51052025-02-23T09:19:49.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d8f6ddab-0b99-4b9f-95c6-df41be884ff4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
51062025-02-23T09:19:49.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d8f6ddab-0b99-4b9f-95c6-df41be884ff4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
51072025-02-23T09:19:49.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = d8f6ddab-0b99-4b9f-95c6-df41be884ff4 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
51082025-02-23T09:19:49.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ccd1992e-8498-438c-b83c-4b6f75371d48 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51092025-02-23T09:19:49.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ccd1992e-8498-438c-b83c-4b6f75371d48 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51102025-02-23T09:19:49.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ccd1992e-8498-438c-b83c-4b6f75371d48 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51112025-02-23T09:19:50.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = e5909d95-03e1-40e8-a43a-8cbb1d254f24 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
51122025-02-23T09:19:50.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = e5909d95-03e1-40e8-a43a-8cbb1d254f24 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
51132025-02-23T09:19:50.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = e5909d95-03e1-40e8-a43a-8cbb1d254f24 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
51142025-02-23T09:19:50.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c592646e-f309-456e-92d9-c033536147e1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51152025-02-23T09:19:50.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c592646e-f309-456e-92d9-c033536147e1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51162025-02-23T09:19:50.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c592646e-f309-456e-92d9-c033536147e1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
51172025-02-23T09:19:51.062ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-23T09:19:51.061785549Z }
51182025-02-23T09:19:51.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51192025-02-23T09:19:51.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51202025-02-23T09:19:51.091ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_needs_update = true
51212025-02-23T09:19:51.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51222025-02-23T09:19:51.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51232025-02-23T09:19:51.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51242025-02-23T09:19:51.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51252025-02-23T09:19:51.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51262025-02-23T09:19:51.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51272025-02-23T09:19:51.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51282025-02-23T09:19:51.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51292025-02-23T09:19:51.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51302025-02-23T09:19:51.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51312025-02-23T09:19:51.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51322025-02-23T09:19:51.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51332025-02-23T09:19:51.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51342025-02-23T09:19:51.108ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: f0be0cb4-fbd7-4108-a303-a66f178852ff, lookup_type: ById(f0be0cb4-fbd7-4108-a303-a66f178852ff) } result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51352025-02-23T09:19:51.111ZINFOnexus (dropshot_internal): starting update saga for f0be0cb4-fbd7-4108-a303-a66f178852ff actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-23T09:19:51.061785549Z }
51362025-02-23T09:19:51.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 49133 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c response_code = 204 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51372025-02-23T09:19:51.111ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 38921cf8-2ad9-4b0d-a780-bf71ed78a558 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-23T09:19:51.061785549Z }
51382025-02-23T09:19:51.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 38921cf8-2ad9-4b0d-a780-bf71ed78a558 roles = RoleSet { roles: {} } uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51392025-02-23T09:19:51.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 38921cf8-2ad9-4b0d-a780-bf71ed78a558 resource = Database result = Ok(()) uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51402025-02-23T09:19:51.113ZDEBGnexus (dropshot_internal): preparing instance-update saga for f0be0cb4-fbd7-4108-a303-a66f178852ff... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4d6df2eb-1a5b-4206-b58b-5803c59f9b4c uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51412025-02-23T09:19:51.113ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update
51422025-02-23T09:19:51.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7198 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 38921cf8-2ad9-4b0d-a780-bf71ed78a558 response_code = 204 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
51432025-02-23T09:19:51.119ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f0be0cb4-fbd7-4108-a303-a66f178852ff","lookup_type":{"ById":"f0be0cb4-fbd7-4108-a303-a66f178852ff"},"parent":{"key":"821b2b06-0bf7-4afc-8957-c8893994aeac","lookup_type":{"ById":"821b2b06-0bf7-4afc-8957-c8893994aeac"},"parent":{"key":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","lookup_type":{"ById":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51442025-02-23T09:19:51.119ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update
51452025-02-23T09:19:51.169ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update
51462025-02-23T09:19:51.169ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51472025-02-23T09:19:51.177ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51482025-02-23T09:19:51.177ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51492025-02-23T09:19:51.183ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51502025-02-23T09:19:51.183ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51512025-02-23T09:19:51.187ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51522025-02-23T09:19:51.187ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51532025-02-23T09:19:51.192ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51542025-02-23T09:19:51.192ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bfae7b85-f977-42bf-ae10-cc6d7b4e6f68")) node_id = 0 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51552025-02-23T09:19:51.196ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51562025-02-23T09:19:51.196ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51572025-02-23T09:19:51.208ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update
51582025-02-23T09:19:51.213ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51592025-02-23T09:19:51.213ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51602025-02-23T09:19:51.215ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51612025-02-23T09:19:51.216ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51622025-02-23T09:19:51.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51632025-02-23T09:19:51.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51642025-02-23T09:19:51.218ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51652025-02-23T09:19:51.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51662025-02-23T09:19:51.220ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51672025-02-23T09:19:51.220ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51682025-02-23T09:19:51.221ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51692025-02-23T09:19:51.222ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51702025-02-23T09:19:51.223ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51712025-02-23T09:19:51.229ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: f0be0cb4-fbd7-4108-a303-a66f178852ff, lookup_type: ById(f0be0cb4-fbd7-4108-a303-a66f178852ff) } result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51722025-02-23T09:19:51.229ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance updater_id = bfae7b85-f977-42bf-ae10-cc6d7b4e6f68
51732025-02-23T09:19:51.229ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51742025-02-23T09:19:51.229ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51752025-02-23T09:19:51.237ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance updater_id = bfae7b85-f977-42bf-ae10-cc6d7b4e6f68
51762025-02-23T09:19:51.237ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51772025-02-23T09:19:51.237ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance
51782025-02-23T09:19:51.241ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff locked_gen = Generation(Generation(2)) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = LockInstance updater_id = bfae7b85-f977-42bf-ae10-cc6d7b4e6f68
51792025-02-23T09:19:51.246ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51802025-02-23T09:19:51.246ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bfae7b85-f977-42bf-ae10-cc6d7b4e6f68")}) node_id = 1 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51812025-02-23T09:19:51.249ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51822025-02-23T09:19:51.249ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
51832025-02-23T09:19:51.257ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51842025-02-23T09:19:51.257ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51852025-02-23T09:19:51.259ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51862025-02-23T09:19:51.259ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51872025-02-23T09:19:51.260ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51882025-02-23T09:19:51.260ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51892025-02-23T09:19:51.261ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51902025-02-23T09:19:51.264ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: f0be0cb4-fbd7-4108-a303-a66f178852ff, lookup_type: ById(f0be0cb4-fbd7-4108-a303-a66f178852ff) } result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51912025-02-23T09:19:51.264ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51922025-02-23T09:19:51.264ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51932025-02-23T09:19:51.270ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 5e1af37a-c8d1-40b1-9b90-66915c077e07, time_created: 2025-02-23T09:19:30.325472Z, time_deleted: None, instance_id: f0be0cb4-fbd7-4108-a303-a66f178852ff, sled_id: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-02-23T09:19:51.061785Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-02-23T09:19:28.091268Z, gen: Generation(Generation(3)), propolis_id: Some(5e1af37a-c8d1-40b1-9b90-66915c077e07), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(5e1af37a-c8d1-40b1-9b90-66915c077e07 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-02-23T09:19:51.270543954Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
51942025-02-23T09:19:51.280ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
51952025-02-23T09:19:51.280ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f0be0cb4-fbd7-4108-a303-a66f178852ff","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"5e1af37a-c8d1-40b1-9b90-66915c077e07"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f0be0cb4-fbd7-4108-a303-a66f178852ff","lookup_type":{"ById":"f0be0cb4-fbd7-4108-a303-a66f178852ff"},"parent":{"key":"821b2b06-0bf7-4afc-8957-c8893994aeac","lookup_type":{"ById":"821b2b06-0bf7-4afc-8957-c8893994aeac"},"parent":{"key":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","lookup_type":{"ById":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"bfae7b85-f977-42bf-ae10-cc6d7b4e6f68"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"821b2b06-0bf7-4afc-8957-c8893994aeac","ram_diff":1073741824},"destroy_active_vmm":"5e1af37a-c8d1-40b1-9b90-66915c077e07","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-02-23T09:19:51.270543954Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51962025-02-23T09:19:51.280ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
51972025-02-23T09:19:51.284ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
51982025-02-23T09:19:51.284ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
51992025-02-23T09:19:51.284ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52002025-02-23T09:19:51.284ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52012025-02-23T09:19:51.288ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52022025-02-23T09:19:51.288ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52032025-02-23T09:19:51.290ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52042025-02-23T09:19:51.290ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52052025-02-23T09:19:51.293ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52062025-02-23T09:19:51.293ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("04099bed-5dcc-434e-a683-8d632e2f6cba")) node_id = 0 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52072025-02-23T09:19:51.296ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52082025-02-23T09:19:51.297ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52092025-02-23T09:19:51.304ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff parent_lock = UpdaterLock { updater_id: bfae7b85-f977-42bf-ae10-cc6d7b4e6f68, locked_gen: Generation(Generation(2)) } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52102025-02-23T09:19:51.304ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = BecomeUpdater
52112025-02-23T09:19:51.304ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = BecomeUpdater
52122025-02-23T09:19:51.313ZDEBGnexus (SagaExecutor): inherited lock from bfae7b85-f977-42bf-ae10-cc6d7b4e6f68 to 04099bed-5dcc-434e-a683-8d632e2f6cba actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = bfae7b85-f977-42bf-ae10-cc6d7b4e6f68 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = BecomeUpdater updater_id = 04099bed-5dcc-434e-a683-8d632e2f6cba
52132025-02-23T09:19:51.313ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52142025-02-23T09:19:51.313ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52152025-02-23T09:19:51.313ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("04099bed-5dcc-434e-a683-8d632e2f6cba")}) node_id = 1 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52162025-02-23T09:19:51.315ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52172025-02-23T09:19:51.315ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52182025-02-23T09:19:51.319ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52192025-02-23T09:19:51.319ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52202025-02-23T09:19:51.322ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52212025-02-23T09:19:51.322ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52222025-02-23T09:19:51.325ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52232025-02-23T09:19:51.327ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff
52242025-02-23T09:19:51.327ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UpdateNetworkConfig
52252025-02-23T09:19:51.327ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UpdateNetworkConfig
52262025-02-23T09:19:51.334ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UpdateNetworkConfig
52272025-02-23T09:19:51.334ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UpdateNetworkConfig
52282025-02-23T09:19:51.336ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
52292025-02-23T09:19:51.337ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UpdateNetworkConfig
52302025-02-23T09:19:51.337ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UpdateNetworkConfig
52312025-02-23T09:19:51.339ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
52322025-02-23T09:19:51.339ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
52332025-02-23T09:19:51.339ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
52342025-02-23T09:19:51.340ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
52352025-02-23T09:19:51.341ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
52362025-02-23T09:19:51.341ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
52372025-02-23T09:19:51.342ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
52382025-02-23T09:19:51.346ZDEBGnexus: notifying dendrite of updates instance_id = Some(f0be0cb4-fbd7-4108-a303-a66f178852ff (instance)) switch = switch0
52392025-02-23T09:19:51.347ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36207, tv_nsec: 45657874 } })
52402025-02-23T09:19:51.347ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1154
52412025-02-23T09:19:51.378ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
52422025-02-23T09:19:51.378ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52432025-02-23T09:19:51.378ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7252d943-e243-4177-96f4-4298a2b573a3", "content-length": "26", "date": "Sun, 23 Feb 2025 09:19:51 GMT"} })
52442025-02-23T09:19:51.378ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52452025-02-23T09:19:51.379ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52462025-02-23T09:19:51.411ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
52472025-02-23T09:19:51.412ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "43a5bf5a-dc1d-4d6f-bf2c-79c449c261c4", "content-length": "4", "date": "Sun, 23 Feb 2025 09:19:50 GMT"} })
52482025-02-23T09:19:51.414ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52492025-02-23T09:19:51.414ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52502025-02-23T09:19:51.422ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52512025-02-23T09:19:51.422ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52522025-02-23T09:19:51.436ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
52532025-02-23T09:19:51.437ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
52542025-02-23T09:19:51.454ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-02-23T09:19:51.439632Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 821b2b06-0bf7-4afc-8957-c8893994aeac, time_modified: Some(2025-02-23T09:19:51.439632Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, time_modified: Some(2025-02-23T09:19:51.439632Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52552025-02-23T09:19:51.454ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52562025-02-23T09:19:51.454ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52572025-02-23T09:19:51.460ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52582025-02-23T09:19:51.460ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52592025-02-23T09:19:51.467ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52602025-02-23T09:19:51.467ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UnassignOximeterProducer
52612025-02-23T09:19:51.468ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UnassignOximeterProducer
52622025-02-23T09:19:51.474ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = de6ca227-55b1-420b-b454-b4242aff85c9 producer_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52632025-02-23T09:19:51.474ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UnassignOximeterProducer
52642025-02-23T09:19:51.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = UnassignOximeterProducer
52652025-02-23T09:19:51.510ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52662025-02-23T09:19:51.510ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f0be0cb4-fbd7-4108-a303-a66f178852ff
52672025-02-23T09:19:51.531ZDEBGnexus (SagaExecutor): client response oximeter-collector = f0be0cb4-fbd7-4108-a303-a66f178852ff result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f0be0cb4-fbd7-4108-a303-a66f178852ff", status: 204, headers: {"x-request-id": "8f4a18fb-2a1a-482d-8dad-5624ce9a0b9a", "date": "Sun, 23 Feb 2025 09:19:51 GMT"} }) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52682025-02-23T09:19:51.531ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = de6ca227-55b1-420b-b454-b4242aff85c9 producer_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52692025-02-23T09:19:51.533ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52702025-02-23T09:19:51.533ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52712025-02-23T09:19:51.537ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52722025-02-23T09:19:51.537ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52732025-02-23T09:19:51.540ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff lock = UpdaterLock { updater_id: 04099bed-5dcc-434e-a683-8d632e2f6cba, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-02-23T09:19:51.270543954Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52742025-02-23T09:19:51.540ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = CommitInstanceUpdates
52752025-02-23T09:19:51.541ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = CommitInstanceUpdates
52762025-02-23T09:19:51.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 098355e4-16d0-451c-b4c6-206f11c71a03 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
52772025-02-23T09:19:51.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 098355e4-16d0-451c-b4c6-206f11c71a03 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
52782025-02-23T09:19:51.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 098355e4-16d0-451c-b4c6-206f11c71a03 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
52792025-02-23T09:19:51.579ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff new_runtime = InstanceRuntimeState { time_updated: 2025-02-23T09:19:51.270543954Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
52802025-02-23T09:19:51.579ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52812025-02-23T09:19:51.579ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52822025-02-23T09:19:51.579ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
52832025-02-23T09:19:51.579ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52842025-02-23T09:19:51.579ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
52852025-02-23T09:19:51.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52862025-02-23T09:19:51.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52872025-02-23T09:19:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52882025-02-23T09:19:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52892025-02-23T09:19:51.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902025-02-23T09:19:51.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52912025-02-23T09:19:51.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52922025-02-23T09:19:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52932025-02-23T09:19:51.583ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
52942025-02-23T09:19:51.583ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
52952025-02-23T09:19:51.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52962025-02-23T09:19:51.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52972025-02-23T09:19:51.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52982025-02-23T09:19:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52992025-02-23T09:19:51.588ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53002025-02-23T09:19:51.588ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f0be0cb4-fbd7-4108-a303-a66f178852ff"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5e1af37a-c8d1-40b1-9b90-66915c077e07")}) node_id = 7 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53012025-02-23T09:19:51.591ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53022025-02-23T09:19:51.591ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53032025-02-23T09:19:51.595ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53042025-02-23T09:19:51.595ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53052025-02-23T09:19:51.598ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53062025-02-23T09:19:51.598ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53072025-02-23T09:19:51.601ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
53082025-02-23T09:19:51.602ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ReleaseSledResources
53092025-02-23T09:19:51.602ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ReleaseSledResources
53102025-02-23T09:19:51.621ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53112025-02-23T09:19:51.621ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53122025-02-23T09:19:51.621ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ee6c67a-16a1-4b16-a96a-d398560b0b40", "content-length": "372", "date": "Sun, 23 Feb 2025 09:19:51 GMT"} })
53132025-02-23T09:19:51.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53142025-02-23T09:19:51.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53152025-02-23T09:19:51.631ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53162025-02-23T09:19:51.631ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53172025-02-23T09:19:51.634ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53182025-02-23T09:19:51.634ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53192025-02-23T09:19:51.638ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
53202025-02-23T09:19:51.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = MarkVmmDeleted
53212025-02-23T09:19:51.638ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = MarkVmmDeleted
53222025-02-23T09:19:51.666ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53232025-02-23T09:19:51.666ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53242025-02-23T09:19:51.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27c50b38-e83a-4c2f-b05c-debaf37ec759", "date": "Sun, 23 Feb 2025 09:19:51 GMT"} })
53252025-02-23T09:19:51.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53262025-02-23T09:19:51.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53272025-02-23T09:19:51.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53282025-02-23T09:19:51.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53292025-02-23T09:19:51.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53302025-02-23T09:19:51.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53312025-02-23T09:19:51.673ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53322025-02-23T09:19:51.673ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53332025-02-23T09:19:51.675ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53342025-02-23T09:19:51.675ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53352025-02-23T09:19:51.676ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "119e1b03-3e95-403e-b50f-68981da7f973", "date": "Sun, 23 Feb 2025 09:19:51 GMT"} })
53362025-02-23T09:19:51.677ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53372025-02-23T09:19:51.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53382025-02-23T09:19:51.678ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 98.160957ms iteration = 24 status = {}
53392025-02-23T09:19:51.681ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53402025-02-23T09:19:51.681ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53412025-02-23T09:19:51.684ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53422025-02-23T09:19:51.684ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53432025-02-23T09:19:51.687ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53442025-02-23T09:19:51.687ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53452025-02-23T09:19:51.688ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53462025-02-23T09:19:51.688ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53472025-02-23T09:19:51.690ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53482025-02-23T09:19:51.690ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53492025-02-23T09:19:51.691ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53502025-02-23T09:19:51.694ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, lookup_type: ById(e9f38e2e-3bd8-4187-a100-da5edd2fe30a) }, key: 821b2b06-0bf7-4afc-8957-c8893994aeac, lookup_type: ById(821b2b06-0bf7-4afc-8957-c8893994aeac) }, key: f0be0cb4-fbd7-4108-a303-a66f178852ff, lookup_type: ById(f0be0cb4-fbd7-4108-a303-a66f178852ff) } result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53512025-02-23T09:19:51.695ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53522025-02-23T09:19:51.695ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_node = ChainSuccessorSaga
53532025-02-23T09:19:51.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53542025-02-23T09:19:51.711ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update
53552025-02-23T09:19:51.711ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53562025-02-23T09:19:51.711ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53572025-02-23T09:19:51.711ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Signaled
53582025-02-23T09:19:51.711ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53592025-02-23T09:19:51.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53602025-02-23T09:19:51.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53612025-02-23T09:19:51.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53622025-02-23T09:19:51.714ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53632025-02-23T09:19:51.714ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53642025-02-23T09:19:51.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53652025-02-23T09:19:51.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53662025-02-23T09:19:51.715ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53672025-02-23T09:19:51.715ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53682025-02-23T09:19:51.717ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53692025-02-23T09:19:51.717ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53702025-02-23T09:19:51.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53712025-02-23T09:19:51.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53722025-02-23T09:19:51.719ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53732025-02-23T09:19:51.719ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53742025-02-23T09:19:51.722ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53752025-02-23T09:19:51.722ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35
53762025-02-23T09:19:51.732ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53772025-02-23T09:19:51.734ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 saga_name = instance-update saga_result = SagaResult { saga_id: a0312f50-a021-4c95-90ea-d7385e0a3b35, saga_log: SagaLog { saga_id: a0312f50-a021-4c95-90ea-d7385e0a3b35, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("04099bed-5dcc-434e-a683-8d632e2f6cba")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("04099bed-5dcc-434e-a683-8d632e2f6cba")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f0be0cb4-fbd7-4108-a303-a66f178852ff"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5e1af37a-c8d1-40b1-9b90-66915c077e07")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f0be0cb4-fbd7-4108-a303-a66f178852ff"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5e1af37a-c8d1-40b1-9b90-66915c077e07")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("04099bed-5dcc-434e-a683-8d632e2f6cba"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("04099bed-5dcc-434e-a683-8d632e2f6cba")}} }) }
53782025-02-23T09:19:51.734ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = a0312f50-a021-4c95-90ea-d7385e0a3b35 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update
53792025-02-23T09:19:51.734ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53802025-02-23T09:19:51.734ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
53812025-02-23T09:19:51.739ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53822025-02-23T09:19:51.739ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
53832025-02-23T09:19:51.742ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53842025-02-23T09:19:51.742ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
53852025-02-23T09:19:51.746ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
53862025-02-23T09:19:51.746ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68
53872025-02-23T09:19:51.755ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53882025-02-23T09:19:51.755ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53892025-02-23T09:19:51.755ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 43.86581ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53902025-02-23T09:19:51.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53912025-02-23T09:19:51.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53922025-02-23T09:19:51.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932025-02-23T09:19:51.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53942025-02-23T09:19:51.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53952025-02-23T09:19:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53962025-02-23T09:19:51.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972025-02-23T09:19:51.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53982025-02-23T09:19:51.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53992025-02-23T09:19:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54002025-02-23T09:19:51.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d52311a7-0b0e-4a21-859c-7b1c92f2d2b4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54012025-02-23T09:19:51.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d52311a7-0b0e-4a21-859c-7b1c92f2d2b4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54022025-02-23T09:19:51.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d52311a7-0b0e-4a21-859c-7b1c92f2d2b4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54032025-02-23T09:19:51.784ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update sec_id = 1c608ad8-8827-4c81-ba57-e92e029dcde3
54042025-02-23T09:19:51.784ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 0db9eab0-0625-487e-a017-33baf3d44c68 saga_name = start-instance-update saga_result = SagaResult { saga_id: 0db9eab0-0625-487e-a017-33baf3d44c68, saga_log: SagaLog { saga_id: 0db9eab0-0625-487e-a017-33baf3d44c68, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("bfae7b85-f977-42bf-ae10-cc6d7b4e6f68")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bfae7b85-f977-42bf-ae10-cc6d7b4e6f68")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("bfae7b85-f977-42bf-ae10-cc6d7b4e6f68"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("bfae7b85-f977-42bf-ae10-cc6d7b4e6f68")}} }) }
54052025-02-23T09:19:51.797ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54062025-02-23T09:19:51.797ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8557bb83-87b2-4394-802d-818c3af02185", "content-length": "691", "date": "Sun, 23 Feb 2025 09:19:51 GMT"} })
54072025-02-23T09:19:51.797ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54082025-02-23T09:19:51.797ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54092025-02-23T09:19:51.797ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54102025-02-23T09:19:51.800ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 220.159129ms iteration = 24 status = {}
54112025-02-23T09:19:52.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 323940fa-6753-42d0-b1c2-866268e57f91 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
54122025-02-23T09:19:52.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 323940fa-6753-42d0-b1c2-866268e57f91 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
54132025-02-23T09:19:52.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 323940fa-6753-42d0-b1c2-866268e57f91 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
54142025-02-23T09:19:52.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3f99e371-a0aa-414b-83cc-837674519dea roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54152025-02-23T09:19:52.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3f99e371-a0aa-414b-83cc-837674519dea resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54162025-02-23T09:19:52.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3f99e371-a0aa-414b-83cc-837674519dea response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54172025-02-23T09:19:53.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2822618d-06b0-4547-a69f-b9a8d6626610 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54182025-02-23T09:19:53.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2822618d-06b0-4547-a69f-b9a8d6626610 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54192025-02-23T09:19:53.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2822618d-06b0-4547-a69f-b9a8d6626610 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54202025-02-23T09:19:54.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
54212025-02-23T09:19:54.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
54222025-02-23T09:19:54.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54232025-02-23T09:19:54.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54242025-02-23T09:19:54.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54252025-02-23T09:19:54.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54262025-02-23T09:19:54.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54272025-02-23T09:19:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54282025-02-23T09:19:54.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54292025-02-23T09:19:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54302025-02-23T09:19:54.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54312025-02-23T09:19:54.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54322025-02-23T09:19:54.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332025-02-23T09:19:54.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
54342025-02-23T09:19:54.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54352025-02-23T09:19:54.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54362025-02-23T09:19:54.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
54372025-02-23T09:19:54.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.547034ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
54382025-02-23T09:19:54.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54392025-02-23T09:19:54.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54402025-02-23T09:19:54.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.816161ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54412025-02-23T09:19:54.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c2c5faf6-84bb-4501-8ac6-f90a06a27e09 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54422025-02-23T09:19:54.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c2c5faf6-84bb-4501-8ac6-f90a06a27e09 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54432025-02-23T09:19:54.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c2c5faf6-84bb-4501-8ac6-f90a06a27e09 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54442025-02-23T09:19:55.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a8e6c3da-932c-4f71-82b2-e73e272e8672 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54452025-02-23T09:19:55.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a8e6c3da-932c-4f71-82b2-e73e272e8672 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54462025-02-23T09:19:55.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a8e6c3da-932c-4f71-82b2-e73e272e8672 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54472025-02-23T09:19:56.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 189b3e8a-0474-442d-b560-dc264e1b6bc0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54482025-02-23T09:19:56.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 189b3e8a-0474-442d-b560-dc264e1b6bc0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54492025-02-23T09:19:56.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 189b3e8a-0474-442d-b560-dc264e1b6bc0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54502025-02-23T09:19:57.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1111 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 95bc64dd-05c2-48fa-bf27-d8b8c30aae86 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
54512025-02-23T09:19:57.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6e1975ef-6dcd-4378-a2cd-1135d248570a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54522025-02-23T09:19:57.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6e1975ef-6dcd-4378-a2cd-1135d248570a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54532025-02-23T09:19:57.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 6e1975ef-6dcd-4378-a2cd-1135d248570a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54542025-02-23T09:19:58.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 94935fe2-03cd-4a0f-9f9c-225231026898 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54552025-02-23T09:19:58.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 94935fe2-03cd-4a0f-9f9c-225231026898 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54562025-02-23T09:19:58.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 94935fe2-03cd-4a0f-9f9c-225231026898 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54572025-02-23T09:19:59.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3a131a19-e37c-42f5-a863-7455686f354f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54582025-02-23T09:19:59.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3a131a19-e37c-42f5-a863-7455686f354f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54592025-02-23T09:19:59.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3a131a19-e37c-42f5-a863-7455686f354f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54602025-02-23T09:20:00.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ddcb963f-ffc3-4fd0-9683-b3bca622772f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54612025-02-23T09:20:00.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ddcb963f-ffc3-4fd0-9683-b3bca622772f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54622025-02-23T09:20:00.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ddcb963f-ffc3-4fd0-9683-b3bca622772f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54632025-02-23T09:20:01.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b586bf82-6bf8-4190-9f5f-9d5fd9e14d48 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54642025-02-23T09:20:01.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b586bf82-6bf8-4190-9f5f-9d5fd9e14d48 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54652025-02-23T09:20:01.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b586bf82-6bf8-4190-9f5f-9d5fd9e14d48 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54662025-02-23T09:20:02.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 88b04961-2a39-4f45-863f-597ccdeb5ad9 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
54672025-02-23T09:20:02.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 88b04961-2a39-4f45-863f-597ccdeb5ad9 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
54682025-02-23T09:20:02.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 88b04961-2a39-4f45-863f-597ccdeb5ad9 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?sort_by=id_ascending
54692025-02-23T09:20:02.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 698489ba-a7fd-4d38-8dd2-4b930a568cb4 roles = RoleSet { roles: {} } uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
54702025-02-23T09:20:02.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 698489ba-a7fd-4d38-8dd2-4b930a568cb4 resource = Database result = Ok(()) uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
54712025-02-23T09:20:02.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49690 req_id = 698489ba-a7fd-4d38-8dd2-4b930a568cb4 response_code = 200 uri = /metrics/collectors/de6ca227-55b1-420b-b454-b4242aff85c9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzBlY2E3Zi03NDdjLTQzMjAtYmJmYS1iYzUzZjAxNzE0ZjkifX0%3D
54722025-02-23T09:20:03.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cdd1416d-4ef6-4a26-a9cb-afa4bd3910ce roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54732025-02-23T09:20:03.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cdd1416d-4ef6-4a26-a9cb-afa4bd3910ce resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54742025-02-23T09:20:03.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cdd1416d-4ef6-4a26-a9cb-afa4bd3910ce response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54752025-02-23T09:20:04.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ca929150-ae36-47a3-b0e7-16aee905d135 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54762025-02-23T09:20:04.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ca929150-ae36-47a3-b0e7-16aee905d135 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54772025-02-23T09:20:04.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ca929150-ae36-47a3-b0e7-16aee905d135 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
54782025-02-23T09:20:04.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
54792025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
54802025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54812025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54822025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
54832025-02-23T09:20:04.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54842025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
54852025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54862025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54872025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
54882025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54892025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54902025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
54912025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
54922025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54932025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54942025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
54952025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
54962025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54972025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
54982025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
54992025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
55002025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55012025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55022025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55032025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
55042025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55052025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
55062025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55072025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
55082025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
55092025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
55102025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55112025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
55122025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55132025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
55142025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55152025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
55162025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55172025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55182025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55192025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55202025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55212025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55222025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55232025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55242025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55252025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55262025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55272025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55282025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55292025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55302025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55312025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55322025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
55332025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55342025-02-23T09:20:04.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55352025-02-23T09:20:04.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36220, tv_nsec: 235017469 } })
55362025-02-23T09:20:04.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
55372025-02-23T09:20:04.537ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55382025-02-23T09:20:04.537ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55392025-02-23T09:20:04.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55402025-02-23T09:20:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55412025-02-23T09:20:04.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55422025-02-23T09:20:04.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432025-02-23T09:20:04.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442025-02-23T09:20:04.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55452025-02-23T09:20:04.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55462025-02-23T09:20:04.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55472025-02-23T09:20:04.540ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.289342ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55482025-02-23T09:20:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55492025-02-23T09:20:04.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55502025-02-23T09:20:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55512025-02-23T09:20:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55522025-02-23T09:20:04.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55532025-02-23T09:20:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55542025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55552025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55562025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55572025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55582025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55592025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55602025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55612025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55622025-02-23T09:20:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55632025-02-23T09:20:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55642025-02-23T09:20:04.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55652025-02-23T09:20:04.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55662025-02-23T09:20:04.547ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55672025-02-23T09:20:04.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55682025-02-23T09:20:04.549ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55692025-02-23T09:20:04.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55702025-02-23T09:20:04.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36220, tv_nsec: 251136651 } })
55712025-02-23T09:20:04.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
55722025-02-23T09:20:04.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55732025-02-23T09:20:04.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55742025-02-23T09:20:04.574ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55752025-02-23T09:20:04.574ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 45.829157ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
55762025-02-23T09:20:04.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55772025-02-23T09:20:04.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55782025-02-23T09:20:04.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36220, tv_nsec: 274350755 } })
55792025-02-23T09:20:04.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55802025-02-23T09:20:04.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55812025-02-23T09:20:04.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
55822025-02-23T09:20:04.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55832025-02-23T09:20:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55842025-02-23T09:20:04.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55852025-02-23T09:20:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55862025-02-23T09:20:04.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55872025-02-23T09:20:04.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55882025-02-23T09:20:04.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.134326ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
55892025-02-23T09:20:04.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55902025-02-23T09:20:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55912025-02-23T09:20:04.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.090507ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55922025-02-23T09:20:04.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55932025-02-23T09:20:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55942025-02-23T09:20:04.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.567041ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55952025-02-23T09:20:04.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55962025-02-23T09:20:04.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55972025-02-23T09:20:04.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 90.767138ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
55982025-02-23T09:20:04.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55992025-02-23T09:20:04.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56002025-02-23T09:20:04.628ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56012025-02-23T09:20:04.628ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56022025-02-23T09:20:04.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56032025-02-23T09:20:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56042025-02-23T09:20:04.630ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
56052025-02-23T09:20:04.630ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56062025-02-23T09:20:04.630ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d25c08-9d57-41a2-8dcf-c74c975e2bb8", "content-length": "26", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56072025-02-23T09:20:04.630ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56082025-02-23T09:20:04.631ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56092025-02-23T09:20:04.631ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56102025-02-23T09:20:04.631ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.711842ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56112025-02-23T09:20:04.632ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56122025-02-23T09:20:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56132025-02-23T09:20:04.633ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56142025-02-23T09:20:04.634ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56152025-02-23T09:20:04.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56162025-02-23T09:20:04.637ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56172025-02-23T09:20:04.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56182025-02-23T09:20:04.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56192025-02-23T09:20:04.639ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
56202025-02-23T09:20:04.639ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56212025-02-23T09:20:04.639ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c973d827-73c0-476c-9e19-6d5b746c7855", "content-length": "26", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56222025-02-23T09:20:04.639ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56232025-02-23T09:20:04.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56242025-02-23T09:20:04.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56252025-02-23T09:20:04.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56262025-02-23T09:20:04.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56272025-02-23T09:20:04.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56282025-02-23T09:20:04.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56292025-02-23T09:20:04.642ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56302025-02-23T09:20:04.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
56312025-02-23T09:20:04.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56322025-02-23T09:20:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56332025-02-23T09:20:04.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56342025-02-23T09:20:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56352025-02-23T09:20:04.646ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 117.496318ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
56362025-02-23T09:20:04.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56372025-02-23T09:20:04.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
56382025-02-23T09:20:04.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56392025-02-23T09:20:04.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56402025-02-23T09:20:04.655ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.892286ms iteration = 24 status = 0
56412025-02-23T09:20:04.665ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
56422025-02-23T09:20:04.665ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 136.420202ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
56432025-02-23T09:20:04.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.182842ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56442025-02-23T09:20:04.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
56452025-02-23T09:20:04.673ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56462025-02-23T09:20:04.674ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5641ec6f-437c-4d68-b531-3dfaa8c98409", "content-length": "26", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56472025-02-23T09:20:04.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56482025-02-23T09:20:04.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
56492025-02-23T09:20:04.683ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
56502025-02-23T09:20:04.683ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 153.91668ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56512025-02-23T09:20:04.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56522025-02-23T09:20:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56532025-02-23T09:20:04.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.699269ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56542025-02-23T09:20:04.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56552025-02-23T09:20:04.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56562025-02-23T09:20:04.716ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56572025-02-23T09:20:04.716ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "59becb72-ec06-420b-aedd-a30f336e4881", "content-length": "2", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56582025-02-23T09:20:04.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56592025-02-23T09:20:04.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56602025-02-23T09:20:04.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56612025-02-23T09:20:04.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56622025-02-23T09:20:04.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56632025-02-23T09:20:04.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56642025-02-23T09:20:04.720ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.178707ms iteration = 27 status = {"physical_disks_added":0}
56652025-02-23T09:20:04.721ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.930021ms iteration = 24 status = {}
56662025-02-23T09:20:04.721ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 192.270528ms iteration = 24 status = null
56672025-02-23T09:20:04.792ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56682025-02-23T09:20:04.792ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56692025-02-23T09:20:04.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56702025-02-23T09:20:04.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56712025-02-23T09:20:04.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56722025-02-23T09:20:04.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56732025-02-23T09:20:04.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56742025-02-23T09:20:04.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56752025-02-23T09:20:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56762025-02-23T09:20:04.867ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
56772025-02-23T09:20:04.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56782025-02-23T09:20:04.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56792025-02-23T09:20:04.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56802025-02-23T09:20:04.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "88cdb620-118e-4d5c-b1cc-681ab4cc220d", "content-length": "134", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56812025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56822025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
56832025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56842025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56852025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56862025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56872025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56882025-02-23T09:20:04.874ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56892025-02-23T09:20:04.875ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56902025-02-23T09:20:04.875ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56912025-02-23T09:20:04.875ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
56922025-02-23T09:20:04.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56932025-02-23T09:20:04.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56942025-02-23T09:20:04.877ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56952025-02-23T09:20:04.877ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61134fef-afe2-44d0-870c-664c58c89c10", "content-length": "2", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56962025-02-23T09:20:04.877ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56972025-02-23T09:20:04.877ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "81842d70-5e89-4907-aa92-1798e7d589c2", "content-length": "52", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
56982025-02-23T09:20:04.877ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
56992025-02-23T09:20:04.877ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57002025-02-23T09:20:04.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbfc5e4-e8ba-4b99-bc53-0471d67d1f8e", "content-length": "372", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
57012025-02-23T09:20:04.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57022025-02-23T09:20:04.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7236b2ef-05a6-4d49-9303-a66ac6fe3e7f", "content-length": "691", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
57032025-02-23T09:20:04.885ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57042025-02-23T09:20:04.885ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57052025-02-23T09:20:04.885ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57062025-02-23T09:20:04.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57072025-02-23T09:20:04.886ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 357.773885ms iteration = 25 status = {}
57082025-02-23T09:20:04.899ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57092025-02-23T09:20:04.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57102025-02-23T09:20:04.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3b76a9b0-31b0-4625-a5c6-59da18575c81", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
57112025-02-23T09:20:04.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57122025-02-23T09:20:04.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57132025-02-23T09:20:04.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57142025-02-23T09:20:04.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57152025-02-23T09:20:04.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57162025-02-23T09:20:04.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57172025-02-23T09:20:04.909ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57182025-02-23T09:20:04.909ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57192025-02-23T09:20:04.910ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59e5dbdc-ac64-4fae-804c-4e47dec25ecd", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
57202025-02-23T09:20:04.911ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.760832ms iteration = 25 status = {}
57212025-02-23T09:20:05.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e00e966b-71b9-4f3c-8d5b-11b3c3a2642c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57222025-02-23T09:20:05.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e00e966b-71b9-4f3c-8d5b-11b3c3a2642c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57232025-02-23T09:20:05.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e00e966b-71b9-4f3c-8d5b-11b3c3a2642c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57242025-02-23T09:20:05.069ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1163ea85-1555-4317-9b5a-92ef097ba8cd", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
57252025-02-23T09:20:05.069ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
57262025-02-23T09:20:05.069ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57272025-02-23T09:20:05.070ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bde5916-f0b7-4184-b87f-6dddc3bed842", "content-length": "682", "date": "Sun, 23 Feb 2025 09:20:04 GMT"} })
57282025-02-23T09:20:05.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57292025-02-23T09:20:05.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57302025-02-23T09:20:05.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57312025-02-23T09:20:05.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57322025-02-23T09:20:05.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57332025-02-23T09:20:05.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57342025-02-23T09:20:05.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57352025-02-23T09:20:05.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57362025-02-23T09:20:05.084ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.79953ms iteration = 24 status = {}
57372025-02-23T09:20:06.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8187a9e9-d8ff-43af-af89-23d13d4c762b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57382025-02-23T09:20:06.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8187a9e9-d8ff-43af-af89-23d13d4c762b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57392025-02-23T09:20:06.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8187a9e9-d8ff-43af-af89-23d13d4c762b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57402025-02-23T09:20:07.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3f46dbf0-b7dd-4343-9a40-fb5e510a5faa roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57412025-02-23T09:20:07.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3f46dbf0-b7dd-4343-9a40-fb5e510a5faa resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57422025-02-23T09:20:07.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3f46dbf0-b7dd-4343-9a40-fb5e510a5faa response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57432025-02-23T09:20:07.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 621 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = f10a3cca-ced0-4f6d-9a19-d49b52c992cb response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
57442025-02-23T09:20:08.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = df85396b-bc7b-467c-8b45-67de27f61503 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57452025-02-23T09:20:08.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = df85396b-bc7b-467c-8b45-67de27f61503 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57462025-02-23T09:20:08.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = df85396b-bc7b-467c-8b45-67de27f61503 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57472025-02-23T09:20:09.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb3fe62c-2e5c-408e-b00d-4e5b0ce81337 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57482025-02-23T09:20:09.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb3fe62c-2e5c-408e-b00d-4e5b0ce81337 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57492025-02-23T09:20:09.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb3fe62c-2e5c-408e-b00d-4e5b0ce81337 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57502025-02-23T09:20:10.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 97510e59-ffab-44c4-af6f-18d0c36c98b8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57512025-02-23T09:20:10.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 97510e59-ffab-44c4-af6f-18d0c36c98b8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57522025-02-23T09:20:10.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 97510e59-ffab-44c4-af6f-18d0c36c98b8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57532025-02-23T09:20:11.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b24f9dd-beec-43e0-82dc-f83dad419092 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57542025-02-23T09:20:11.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b24f9dd-beec-43e0-82dc-f83dad419092 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57552025-02-23T09:20:11.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b24f9dd-beec-43e0-82dc-f83dad419092 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57562025-02-23T09:20:12.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0a856cf7-7936-4725-bc52-46e94099d5ba roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57572025-02-23T09:20:12.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0a856cf7-7936-4725-bc52-46e94099d5ba resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57582025-02-23T09:20:12.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0a856cf7-7936-4725-bc52-46e94099d5ba response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57592025-02-23T09:20:13.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = da651e15-a903-4e23-9332-dc3b7e831260 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57602025-02-23T09:20:13.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = da651e15-a903-4e23-9332-dc3b7e831260 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57612025-02-23T09:20:13.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = da651e15-a903-4e23-9332-dc3b7e831260 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57622025-02-23T09:20:14.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 93acb80d-b21e-4faa-b352-aa9c638e1099 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57632025-02-23T09:20:14.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 93acb80d-b21e-4faa-b352-aa9c638e1099 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57642025-02-23T09:20:14.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 93acb80d-b21e-4faa-b352-aa9c638e1099 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57652025-02-23T09:20:14.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
57662025-02-23T09:20:14.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
57672025-02-23T09:20:14.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57682025-02-23T09:20:14.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57692025-02-23T09:20:14.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57702025-02-23T09:20:14.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57712025-02-23T09:20:14.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57722025-02-23T09:20:14.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57732025-02-23T09:20:14.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57742025-02-23T09:20:14.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.192989ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57752025-02-23T09:20:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57762025-02-23T09:20:14.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57772025-02-23T09:20:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57782025-02-23T09:20:14.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57792025-02-23T09:20:14.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57802025-02-23T09:20:14.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57812025-02-23T09:20:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
57822025-02-23T09:20:14.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57832025-02-23T09:20:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57842025-02-23T09:20:14.547ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
57852025-02-23T09:20:14.547ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.760691ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
57862025-02-23T09:20:15.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 082ff200-f747-4d90-8bee-2760d06976fc roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57872025-02-23T09:20:15.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 082ff200-f747-4d90-8bee-2760d06976fc resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57882025-02-23T09:20:15.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 082ff200-f747-4d90-8bee-2760d06976fc response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57892025-02-23T09:20:16.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = daa3001c-41c5-43b9-a6e4-557a47105fd1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57902025-02-23T09:20:16.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = daa3001c-41c5-43b9-a6e4-557a47105fd1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57912025-02-23T09:20:16.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = daa3001c-41c5-43b9-a6e4-557a47105fd1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57922025-02-23T09:20:17.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = ee1fd80a-4892-4fe1-9f15-ca019f009e94 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
57932025-02-23T09:20:17.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3d61d969-514a-45c2-b85d-6d4889e5d768 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57942025-02-23T09:20:17.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3d61d969-514a-45c2-b85d-6d4889e5d768 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57952025-02-23T09:20:17.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3d61d969-514a-45c2-b85d-6d4889e5d768 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57962025-02-23T09:20:18.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8600bfdf-220a-4fc9-a76b-f7bbc302f16e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57972025-02-23T09:20:18.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8600bfdf-220a-4fc9-a76b-f7bbc302f16e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57982025-02-23T09:20:18.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8600bfdf-220a-4fc9-a76b-f7bbc302f16e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
57992025-02-23T09:20:19.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d8689c6d-3fdc-4a8b-99f6-4c4f64578c72 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58002025-02-23T09:20:19.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d8689c6d-3fdc-4a8b-99f6-4c4f64578c72 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58012025-02-23T09:20:19.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d8689c6d-3fdc-4a8b-99f6-4c4f64578c72 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58022025-02-23T09:20:20.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 478b18fc-f4cd-4d28-b9b6-06be63b4e334 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58032025-02-23T09:20:20.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 478b18fc-f4cd-4d28-b9b6-06be63b4e334 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58042025-02-23T09:20:20.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 478b18fc-f4cd-4d28-b9b6-06be63b4e334 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58052025-02-23T09:20:21.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0929767f-180a-495b-b4e0-fb1ec4d1db85 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58062025-02-23T09:20:21.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0929767f-180a-495b-b4e0-fb1ec4d1db85 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58072025-02-23T09:20:21.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0929767f-180a-495b-b4e0-fb1ec4d1db85 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58082025-02-23T09:20:22.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e9f1460-e079-48bb-9d56-d1bf887ab6c2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58092025-02-23T09:20:22.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e9f1460-e079-48bb-9d56-d1bf887ab6c2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58102025-02-23T09:20:22.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3e9f1460-e079-48bb-9d56-d1bf887ab6c2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58112025-02-23T09:20:22.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 2325c2a6-74f1-48b8-ba06-d324d2a34382 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
58122025-02-23T09:20:22.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 2325c2a6-74f1-48b8-ba06-d324d2a34382 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
58132025-02-23T09:20:22.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 2325c2a6-74f1-48b8-ba06-d324d2a34382 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
58142025-02-23T09:20:23.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d8015982-5cd0-4333-9450-5642ece44c25 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58152025-02-23T09:20:23.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d8015982-5cd0-4333-9450-5642ece44c25 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58162025-02-23T09:20:23.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d8015982-5cd0-4333-9450-5642ece44c25 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58172025-02-23T09:20:24.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b78475f-e891-4d0c-aa74-1756cf969bd0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58182025-02-23T09:20:24.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b78475f-e891-4d0c-aa74-1756cf969bd0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58192025-02-23T09:20:24.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b78475f-e891-4d0c-aa74-1756cf969bd0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58202025-02-23T09:20:24.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
58212025-02-23T09:20:24.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
58222025-02-23T09:20:24.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58232025-02-23T09:20:24.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58242025-02-23T09:20:24.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58252025-02-23T09:20:24.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58262025-02-23T09:20:24.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58272025-02-23T09:20:24.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58282025-02-23T09:20:24.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58292025-02-23T09:20:24.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.468575ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58302025-02-23T09:20:24.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58312025-02-23T09:20:24.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58322025-02-23T09:20:24.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58332025-02-23T09:20:24.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58342025-02-23T09:20:24.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58352025-02-23T09:20:24.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58362025-02-23T09:20:24.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
58372025-02-23T09:20:24.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58382025-02-23T09:20:24.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58392025-02-23T09:20:24.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
58402025-02-23T09:20:24.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.94913ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
58412025-02-23T09:20:25.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa1df141-5e8f-463f-9f81-98bf70010445 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58422025-02-23T09:20:25.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa1df141-5e8f-463f-9f81-98bf70010445 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58432025-02-23T09:20:25.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa1df141-5e8f-463f-9f81-98bf70010445 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58442025-02-23T09:20:26.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d8772c6-63a0-457d-b41d-9bea88cb690b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58452025-02-23T09:20:26.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d8772c6-63a0-457d-b41d-9bea88cb690b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58462025-02-23T09:20:26.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1d8772c6-63a0-457d-b41d-9bea88cb690b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58472025-02-23T09:20:27.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1099 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 9dac0617-6a83-4e1a-a213-0bebf7b9f470 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
58482025-02-23T09:20:27.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9dfc57ec-7514-4a51-85e8-7893c6cde0a4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58492025-02-23T09:20:27.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9dfc57ec-7514-4a51-85e8-7893c6cde0a4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58502025-02-23T09:20:27.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9dfc57ec-7514-4a51-85e8-7893c6cde0a4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58512025-02-23T09:20:28.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bcc7b3ca-d022-4dc6-8b01-6150d4bbeec0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58522025-02-23T09:20:28.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bcc7b3ca-d022-4dc6-8b01-6150d4bbeec0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58532025-02-23T09:20:28.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = bcc7b3ca-d022-4dc6-8b01-6150d4bbeec0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58542025-02-23T09:20:29.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 19c046d8-ecc9-465c-95ce-b000a2bb99a6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58552025-02-23T09:20:29.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 19c046d8-ecc9-465c-95ce-b000a2bb99a6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58562025-02-23T09:20:29.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 19c046d8-ecc9-465c-95ce-b000a2bb99a6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58572025-02-23T09:20:30.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b56ae066-4f91-4a14-bc66-210e8b5470e5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58582025-02-23T09:20:30.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b56ae066-4f91-4a14-bc66-210e8b5470e5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58592025-02-23T09:20:30.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b56ae066-4f91-4a14-bc66-210e8b5470e5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58602025-02-23T09:20:31.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f282d34c-0b68-4c2b-90e0-334985b4d6ab roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58612025-02-23T09:20:31.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f282d34c-0b68-4c2b-90e0-334985b4d6ab resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58622025-02-23T09:20:31.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f282d34c-0b68-4c2b-90e0-334985b4d6ab response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58632025-02-23T09:20:32.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 88406812-9e89-40b0-bbba-ef71d31ec7f5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58642025-02-23T09:20:32.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 88406812-9e89-40b0-bbba-ef71d31ec7f5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58652025-02-23T09:20:32.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 88406812-9e89-40b0-bbba-ef71d31ec7f5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58662025-02-23T09:20:33.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb73c16c-bfcc-48a8-840c-9755b579dfd2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58672025-02-23T09:20:33.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb73c16c-bfcc-48a8-840c-9755b579dfd2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58682025-02-23T09:20:33.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cb73c16c-bfcc-48a8-840c-9755b579dfd2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
58692025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
58702025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
58712025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58722025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58732025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58742025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
58752025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
58762025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
58772025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58782025-02-23T09:20:34.528ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
58792025-02-23T09:20:34.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.281\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
58802025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
58812025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
58822025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58832025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
58842025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
58852025-02-23T09:20:34.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58862025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58872025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
58882025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58892025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58902025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
58912025-02-23T09:20:34.529ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:10:34.529006798 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58922025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58932025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
58942025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58952025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58962025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
58972025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58982025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
58992025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59002025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
59012025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
59022025-02-23T09:20:34.529ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59032025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59042025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
59052025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
59062025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59072025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59082025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
59092025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
59102025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59112025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
59122025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
59132025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59142025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
59152025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59162025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59172025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
59182025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59192025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59202025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
59212025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59222025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59232025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
59242025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59252025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59262025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
59272025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59282025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59292025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59302025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
59312025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59322025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
59332025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
59342025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59352025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59362025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
59372025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59382025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59392025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59402025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
59412025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
59422025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
59432025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
59442025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59452025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59462025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
59472025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59482025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59492025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59502025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59512025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59522025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59532025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59542025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59552025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59562025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59572025-02-23T09:20:34.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59582025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
59592025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
59602025-02-23T09:20:34.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 36250, tv_nsec: 228261876 } })
59612025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59622025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59632025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59642025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59652025-02-23T09:20:34.530ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 36250, tv_nsec: 228358538 } })
59662025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
59672025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59682025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59692025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59702025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59712025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
59722025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.446437ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
59732025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59742025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
59752025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.849414ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
59762025-02-23T09:20:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59772025-02-23T09:20:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59782025-02-23T09:20:34.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59792025-02-23T09:20:34.535ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.696115ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59802025-02-23T09:20:34.535ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59812025-02-23T09:20:34.535ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59822025-02-23T09:20:34.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59832025-02-23T09:20:34.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59842025-02-23T09:20:34.536ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:10:34.529006798 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59852025-02-23T09:20:34.536ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.295817ms iteration = 13 status = {"expiration":"2025-02-23T09:10:34.529006798Z","pruned":[]}
59862025-02-23T09:20:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59872025-02-23T09:20:34.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59882025-02-23T09:20:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59892025-02-23T09:20:34.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59902025-02-23T09:20:34.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36250, tv_nsec: 236767385 } })
59912025-02-23T09:20:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59922025-02-23T09:20:34.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
59932025-02-23T09:20:34.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59942025-02-23T09:20:34.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59952025-02-23T09:20:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59962025-02-23T09:20:34.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972025-02-23T09:20:34.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59982025-02-23T09:20:34.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59992025-02-23T09:20:34.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60002025-02-23T09:20:34.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60012025-02-23T09:20:34.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60022025-02-23T09:20:34.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60032025-02-23T09:20:34.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60042025-02-23T09:20:34.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60052025-02-23T09:20:34.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60062025-02-23T09:20:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60072025-02-23T09:20:34.546ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60082025-02-23T09:20:34.546ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60092025-02-23T09:20:34.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60102025-02-23T09:20:34.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60112025-02-23T09:20:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60122025-02-23T09:20:34.551ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60132025-02-23T09:20:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60142025-02-23T09:20:34.551ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60152025-02-23T09:20:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60162025-02-23T09:20:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60172025-02-23T09:20:34.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60182025-02-23T09:20:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60192025-02-23T09:20:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60202025-02-23T09:20:34.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60212025-02-23T09:20:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60222025-02-23T09:20:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60232025-02-23T09:20:34.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60242025-02-23T09:20:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60252025-02-23T09:20:34.553ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60262025-02-23T09:20:34.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60272025-02-23T09:20:34.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36250, tv_nsec: 253336795 } })
60282025-02-23T09:20:34.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60292025-02-23T09:20:34.555ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
60302025-02-23T09:20:34.556ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60312025-02-23T09:20:34.557ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.77879ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
60322025-02-23T09:20:34.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60332025-02-23T09:20:34.557ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60342025-02-23T09:20:34.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60352025-02-23T09:20:34.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60362025-02-23T09:20:34.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60372025-02-23T09:20:34.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60382025-02-23T09:20:34.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 30.363738ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
60392025-02-23T09:20:34.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60402025-02-23T09:20:34.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60412025-02-23T09:20:34.561ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60422025-02-23T09:20:34.562ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
60432025-02-23T09:20:34.562ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
60442025-02-23T09:20:34.562ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 33.009507ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
60452025-02-23T09:20:34.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60462025-02-23T09:20:34.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60472025-02-23T09:20:34.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60482025-02-23T09:20:34.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60492025-02-23T09:20:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60502025-02-23T09:20:34.568ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60512025-02-23T09:20:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60522025-02-23T09:20:34.568ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60532025-02-23T09:20:34.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60542025-02-23T09:20:34.569ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60552025-02-23T09:20:34.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60562025-02-23T09:20:34.570ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60572025-02-23T09:20:34.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.205131ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
60582025-02-23T09:20:34.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60592025-02-23T09:20:34.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60602025-02-23T09:20:34.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60612025-02-23T09:20:34.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36250, tv_nsec: 275269035 } })
60622025-02-23T09:20:34.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60632025-02-23T09:20:34.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.168681ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60642025-02-23T09:20:34.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60652025-02-23T09:20:34.577ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
60662025-02-23T09:20:34.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60672025-02-23T09:20:34.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60682025-02-23T09:20:34.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60692025-02-23T09:20:34.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60702025-02-23T09:20:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60712025-02-23T09:20:34.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60722025-02-23T09:20:34.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60732025-02-23T09:20:34.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60742025-02-23T09:20:34.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60752025-02-23T09:20:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60762025-02-23T09:20:34.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60772025-02-23T09:20:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60782025-02-23T09:20:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60792025-02-23T09:20:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60802025-02-23T09:20:34.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60812025-02-23T09:20:34.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60822025-02-23T09:20:34.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60832025-02-23T09:20:34.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60842025-02-23T09:20:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60852025-02-23T09:20:34.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862025-02-23T09:20:34.614ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.637203ms iteration = 6 status = {"nsuccess":5}
60872025-02-23T09:20:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
60882025-02-23T09:20:34.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60892025-02-23T09:20:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60902025-02-23T09:20:34.621ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60912025-02-23T09:20:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60922025-02-23T09:20:34.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60932025-02-23T09:20:34.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.243472ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60942025-02-23T09:20:34.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.134169ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60952025-02-23T09:20:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60962025-02-23T09:20:34.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60972025-02-23T09:20:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60982025-02-23T09:20:34.630ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
60992025-02-23T09:20:34.630ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61002025-02-23T09:20:34.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61012025-02-23T09:20:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61022025-02-23T09:20:34.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61032025-02-23T09:20:34.635ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 105.633617ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
61042025-02-23T09:20:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61052025-02-23T09:20:34.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61062025-02-23T09:20:34.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61072025-02-23T09:20:34.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61082025-02-23T09:20:34.640ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
61092025-02-23T09:20:34.640ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
61102025-02-23T09:20:34.640ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
61112025-02-23T09:20:34.640ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 111.481936ms iteration = 13 status = {"generation":1}
61122025-02-23T09:20:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61132025-02-23T09:20:34.652ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61142025-02-23T09:20:34.652ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61152025-02-23T09:20:34.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61162025-02-23T09:20:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61172025-02-23T09:20:34.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61182025-02-23T09:20:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61192025-02-23T09:20:34.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.168218ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61202025-02-23T09:20:34.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61212025-02-23T09:20:34.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61222025-02-23T09:20:34.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61232025-02-23T09:20:34.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61242025-02-23T09:20:34.678ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61252025-02-23T09:20:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61262025-02-23T09:20:34.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61272025-02-23T09:20:34.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61282025-02-23T09:20:34.680ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61292025-02-23T09:20:34.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61302025-02-23T09:20:34.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61312025-02-23T09:20:34.682ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61322025-02-23T09:20:34.682ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61332025-02-23T09:20:34.682ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 153.661576ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61342025-02-23T09:20:34.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61352025-02-23T09:20:34.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61362025-02-23T09:20:34.685ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61372025-02-23T09:20:34.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61382025-02-23T09:20:34.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
61392025-02-23T09:20:34.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61402025-02-23T09:20:34.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61412025-02-23T09:20:34.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eac9f37b-2da9-4b12-a8de-8868ae43cf46 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
61422025-02-23T09:20:34.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
61432025-02-23T09:20:34.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61442025-02-23T09:20:34.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61452025-02-23T09:20:34.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eac9f37b-2da9-4b12-a8de-8868ae43cf46 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
61462025-02-23T09:20:34.689ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 160.505153ms iteration = 25 status = 0
61472025-02-23T09:20:34.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482025-02-23T09:20:34.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61492025-02-23T09:20:34.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61502025-02-23T09:20:34.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61512025-02-23T09:20:34.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eac9f37b-2da9-4b12-a8de-8868ae43cf46 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
61522025-02-23T09:20:34.698ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61532025-02-23T09:20:34.698ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61542025-02-23T09:20:34.698ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61552025-02-23T09:20:34.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61562025-02-23T09:20:34.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61572025-02-23T09:20:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61582025-02-23T09:20:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61592025-02-23T09:20:34.706ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61602025-02-23T09:20:34.706ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 176.88516ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61612025-02-23T09:20:34.708ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.243394ms iteration = 28 status = {"physical_disks_added":0}
61622025-02-23T09:20:34.708ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
61632025-02-23T09:20:34.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 179.364356ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
61642025-02-23T09:20:34.715ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61652025-02-23T09:20:34.715ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61662025-02-23T09:20:34.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 187.119091ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61672025-02-23T09:20:34.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
61682025-02-23T09:20:34.720ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61692025-02-23T09:20:34.721ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dc9c1c7-2028-4b69-9fd3-ee841e5042a1", "content-length": "26", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
61702025-02-23T09:20:34.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61712025-02-23T09:20:34.724ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
61722025-02-23T09:20:34.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
61732025-02-23T09:20:34.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61742025-02-23T09:20:34.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61752025-02-23T09:20:34.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61762025-02-23T09:20:34.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61772025-02-23T09:20:34.746ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
61782025-02-23T09:20:34.746ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 217.247685ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
61792025-02-23T09:20:34.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61802025-02-23T09:20:34.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
61812025-02-23T09:20:34.751ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61822025-02-23T09:20:34.752ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fc53d15-0250-4a92-b026-4ad70afb9434", "content-length": "26", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
61832025-02-23T09:20:34.752ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61842025-02-23T09:20:34.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61852025-02-23T09:20:34.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61862025-02-23T09:20:34.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61872025-02-23T09:20:34.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61882025-02-23T09:20:34.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61892025-02-23T09:20:34.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61902025-02-23T09:20:34.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61912025-02-23T09:20:34.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61922025-02-23T09:20:34.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61932025-02-23T09:20:34.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61942025-02-23T09:20:34.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61952025-02-23T09:20:34.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61962025-02-23T09:20:34.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61972025-02-23T09:20:34.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61982025-02-23T09:20:34.802ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) }
61992025-02-23T09:20:34.802ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 273.438297ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62002025-02-23T09:20:34.804ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62012025-02-23T09:20:34.804ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
62022025-02-23T09:20:34.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62032025-02-23T09:20:34.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62042025-02-23T09:20:34.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052025-02-23T09:20:34.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62062025-02-23T09:20:34.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62072025-02-23T09:20:34.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62082025-02-23T09:20:34.826ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62092025-02-23T09:20:34.826ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 297.312934ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62102025-02-23T09:20:34.891ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62112025-02-23T09:20:34.891ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ed661694-e376-4768-90a2-2f88b9e6348d", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62122025-02-23T09:20:34.891ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62132025-02-23T09:20:34.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4740871a-7e98-4a70-8518-b3a13946d3fe", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62142025-02-23T09:20:34.893ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62152025-02-23T09:20:34.894ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62162025-02-23T09:20:34.894ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 365.675103ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62172025-02-23T09:20:34.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
62182025-02-23T09:20:34.908ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62192025-02-23T09:20:34.908ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14c7cc72-7b9a-4ef2-bbf2-ec58b50d65b2", "content-length": "26", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62202025-02-23T09:20:34.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62212025-02-23T09:20:34.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62222025-02-23T09:20:34.956ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62232025-02-23T09:20:34.956ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62242025-02-23T09:20:34.956ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "480c55f7-9b64-45b6-9933-d3fa529a2f9f", "content-length": "372", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62252025-02-23T09:20:34.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62262025-02-23T09:20:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62272025-02-23T09:20:34.958ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
62282025-02-23T09:20:34.958ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62292025-02-23T09:20:34.958ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
62302025-02-23T09:20:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 429.442346ms iteration = 13 status = {"generation":2}
62312025-02-23T09:20:34.971ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62322025-02-23T09:20:34.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62332025-02-23T09:20:34.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "255b276d-ec5b-4e63-a11d-1b9ac9759fcc", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62342025-02-23T09:20:34.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62352025-02-23T09:20:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62362025-02-23T09:20:34.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62372025-02-23T09:20:34.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62382025-02-23T09:20:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62392025-02-23T09:20:34.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62402025-02-23T09:20:34.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62412025-02-23T09:20:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62422025-02-23T09:20:35.002ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62432025-02-23T09:20:35.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62442025-02-23T09:20:35.049ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62452025-02-23T09:20:35.049ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d8aa315-6679-45df-9989-e4cb38a596d0", "content-length": "2", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62462025-02-23T09:20:35.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62472025-02-23T09:20:35.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62482025-02-23T09:20:35.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 524.111007ms iteration = 25 status = null
62492025-02-23T09:20:35.068ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 539.564387ms iteration = 25 status = {}
62502025-02-23T09:20:35.092ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "41e26bf9-cb75-4101-8510-d3d1e65aea89", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62512025-02-23T09:20:35.094ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 565.260117ms iteration = 26 status = {}
62522025-02-23T09:20:35.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c76267ee-6eeb-48e0-b0b8-512eb68f4ed2", "content-length": "691", "date": "Sun, 23 Feb 2025 09:20:35 GMT"} })
62532025-02-23T09:20:35.094ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62542025-02-23T09:20:35.094ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62552025-02-23T09:20:35.094ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62562025-02-23T09:20:35.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62572025-02-23T09:20:35.095ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 566.765265ms iteration = 26 status = {}
62582025-02-23T09:20:35.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c63d39bd-9b1f-4c85-933e-e072d6333258", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62592025-02-23T09:20:35.095ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62602025-02-23T09:20:35.097ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ee1792aa-3c83-4230-a350-fa0ebe46bb3f", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62612025-02-23T09:20:35.097ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62622025-02-23T09:20:35.099ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fd031144-463d-4ab7-b3ae-8bbffe858a57", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62632025-02-23T09:20:35.099ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62642025-02-23T09:20:35.100ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62652025-02-23T09:20:35.100ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 571.486734ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62662025-02-23T09:20:35.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62672025-02-23T09:20:35.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62682025-02-23T09:20:35.137ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
62692025-02-23T09:20:35.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62702025-02-23T09:20:35.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62712025-02-23T09:20:35.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62722025-02-23T09:20:35.148ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "54eb6aea-8890-4b22-9f9a-e72469e7c443", "content-length": "134", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62732025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62742025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
62752025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62762025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62772025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62782025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62792025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62802025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62812025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62822025-02-23T09:20:35.148ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62832025-02-23T09:20:35.149ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
62842025-02-23T09:20:35.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62852025-02-23T09:20:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62862025-02-23T09:20:35.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62872025-02-23T09:20:35.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dae9a52-2035-439f-bce7-d98855818b34", "content-length": "2", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62882025-02-23T09:20:35.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62892025-02-23T09:20:35.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3d9c7f0-c906-4ec7-9abf-febb282eb9c3", "content-length": "52", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62902025-02-23T09:20:35.151ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
62912025-02-23T09:20:35.151ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62922025-02-23T09:20:35.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dc853764-ac7f-4ef5-9acf-fedb29fba05b", "date": "Sun, 23 Feb 2025 09:20:35 GMT"} })
62932025-02-23T09:20:35.325ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
62942025-02-23T09:20:35.325ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62952025-02-23T09:20:35.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9615eef9-6c1f-44e9-b972-b747016b47ed", "content-length": "682", "date": "Sun, 23 Feb 2025 09:20:34 GMT"} })
62962025-02-23T09:20:35.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62972025-02-23T09:20:35.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62982025-02-23T09:20:35.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62992025-02-23T09:20:35.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63002025-02-23T09:20:35.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63012025-02-23T09:20:35.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63022025-02-23T09:20:35.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63032025-02-23T09:20:35.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63042025-02-23T09:20:35.343ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 814.610413ms iteration = 25 status = {}
63052025-02-23T09:20:35.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7ce43c56-813b-46f7-95ec-0e237540b51b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63062025-02-23T09:20:35.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7ce43c56-813b-46f7-95ec-0e237540b51b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63072025-02-23T09:20:35.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7ce43c56-813b-46f7-95ec-0e237540b51b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63082025-02-23T09:20:36.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eef4f159-7697-473b-a003-09f909adca98 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63092025-02-23T09:20:36.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eef4f159-7697-473b-a003-09f909adca98 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63102025-02-23T09:20:36.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eef4f159-7697-473b-a003-09f909adca98 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63112025-02-23T09:20:37.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 702 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 19a2cf79-b6d8-4605-b0a9-7eaae58cec67 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
63122025-02-23T09:20:37.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f946e349-54f3-4407-b532-91c341d47bc1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63132025-02-23T09:20:37.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f946e349-54f3-4407-b532-91c341d47bc1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63142025-02-23T09:20:37.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f946e349-54f3-4407-b532-91c341d47bc1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63152025-02-23T09:20:38.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1c25f9c9-f1ca-4713-97e8-a9bff30654cf roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63162025-02-23T09:20:38.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1c25f9c9-f1ca-4713-97e8-a9bff30654cf resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63172025-02-23T09:20:38.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 1c25f9c9-f1ca-4713-97e8-a9bff30654cf response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63182025-02-23T09:20:39.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e2397b4c-70e5-46e7-a0a1-461862553ff2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63192025-02-23T09:20:39.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e2397b4c-70e5-46e7-a0a1-461862553ff2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63202025-02-23T09:20:39.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e2397b4c-70e5-46e7-a0a1-461862553ff2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63212025-02-23T09:20:40.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 207852e8-20fe-440f-9dc1-c0ed44c1df05 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63222025-02-23T09:20:40.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 207852e8-20fe-440f-9dc1-c0ed44c1df05 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63232025-02-23T09:20:40.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 207852e8-20fe-440f-9dc1-c0ed44c1df05 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63242025-02-23T09:20:41.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 44f0bc31-d1e8-4642-a7e4-f3079cdbe52b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63252025-02-23T09:20:41.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 44f0bc31-d1e8-4642-a7e4-f3079cdbe52b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63262025-02-23T09:20:41.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 44f0bc31-d1e8-4642-a7e4-f3079cdbe52b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63272025-02-23T09:20:42.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 61cdd251-92c5-4df0-b7e9-537ff69beaf0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63282025-02-23T09:20:42.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 61cdd251-92c5-4df0-b7e9-537ff69beaf0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63292025-02-23T09:20:42.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 61cdd251-92c5-4df0-b7e9-537ff69beaf0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63302025-02-23T09:20:43.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9647ea2b-3673-4f5d-bae4-ff531c3663c2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63312025-02-23T09:20:43.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9647ea2b-3673-4f5d-bae4-ff531c3663c2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63322025-02-23T09:20:43.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9647ea2b-3673-4f5d-bae4-ff531c3663c2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63332025-02-23T09:20:44.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
63342025-02-23T09:20:44.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63352025-02-23T09:20:44.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
63362025-02-23T09:20:44.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63372025-02-23T09:20:44.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63382025-02-23T09:20:44.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63392025-02-23T09:20:44.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63402025-02-23T09:20:44.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63412025-02-23T09:20:44.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422025-02-23T09:20:44.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.655889ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63432025-02-23T09:20:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63442025-02-23T09:20:44.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63452025-02-23T09:20:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63462025-02-23T09:20:44.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63472025-02-23T09:20:44.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63482025-02-23T09:20:44.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63492025-02-23T09:20:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
63502025-02-23T09:20:44.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63512025-02-23T09:20:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63522025-02-23T09:20:44.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
63532025-02-23T09:20:44.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.50854ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
63542025-02-23T09:20:44.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 25ea2e2b-83c9-474d-8f0c-68a18cbd62bd roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63552025-02-23T09:20:44.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 25ea2e2b-83c9-474d-8f0c-68a18cbd62bd resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63562025-02-23T09:20:44.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 25ea2e2b-83c9-474d-8f0c-68a18cbd62bd response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63572025-02-23T09:20:45.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9277f48c-cc16-445a-93d9-39724f76ea0e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63582025-02-23T09:20:45.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9277f48c-cc16-445a-93d9-39724f76ea0e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63592025-02-23T09:20:45.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9277f48c-cc16-445a-93d9-39724f76ea0e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63602025-02-23T09:20:46.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d3cbdf9c-df4f-4f49-bc3b-14f84749edd3 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63612025-02-23T09:20:46.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d3cbdf9c-df4f-4f49-bc3b-14f84749edd3 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63622025-02-23T09:20:46.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d3cbdf9c-df4f-4f49-bc3b-14f84749edd3 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63632025-02-23T09:20:47.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 580 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 9712ac64-13ab-431f-bc03-f993541cf326 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
63642025-02-23T09:20:47.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4015f63e-4f29-40f5-9b9c-4640ae02a343 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63652025-02-23T09:20:47.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4015f63e-4f29-40f5-9b9c-4640ae02a343 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63662025-02-23T09:20:47.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4015f63e-4f29-40f5-9b9c-4640ae02a343 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63672025-02-23T09:20:49.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4507318-52d8-49da-8377-b21fd217404d roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63682025-02-23T09:20:49.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4507318-52d8-49da-8377-b21fd217404d resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63692025-02-23T09:20:49.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4507318-52d8-49da-8377-b21fd217404d response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63702025-02-23T09:20:50.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa610430-753b-42cc-b8d8-71ee635adb8c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63712025-02-23T09:20:50.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa610430-753b-42cc-b8d8-71ee635adb8c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63722025-02-23T09:20:50.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = fa610430-753b-42cc-b8d8-71ee635adb8c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63732025-02-23T09:20:51.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 72408dd8-ceb4-49cf-a392-03bbbef46497 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63742025-02-23T09:20:51.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 72408dd8-ceb4-49cf-a392-03bbbef46497 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63752025-02-23T09:20:51.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 72408dd8-ceb4-49cf-a392-03bbbef46497 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63762025-02-23T09:20:51.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = bad6a41b-7151-4a2a-b7e8-443212b3c539 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
63772025-02-23T09:20:51.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = bad6a41b-7151-4a2a-b7e8-443212b3c539 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
63782025-02-23T09:20:51.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = bad6a41b-7151-4a2a-b7e8-443212b3c539 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
63792025-02-23T09:20:52.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20114e7f-c688-4858-b5d8-7a2a66e8939f roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63802025-02-23T09:20:52.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20114e7f-c688-4858-b5d8-7a2a66e8939f resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63812025-02-23T09:20:52.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 20114e7f-c688-4858-b5d8-7a2a66e8939f response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63822025-02-23T09:20:53.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 956c6af1-5594-47bb-98c4-25dc6e37f1e7 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63832025-02-23T09:20:53.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 956c6af1-5594-47bb-98c4-25dc6e37f1e7 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63842025-02-23T09:20:53.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 956c6af1-5594-47bb-98c4-25dc6e37f1e7 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63852025-02-23T09:20:54.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2cbcb064-90d2-4208-b93c-b224ffa5f0b9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63862025-02-23T09:20:54.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2cbcb064-90d2-4208-b93c-b224ffa5f0b9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63872025-02-23T09:20:54.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2cbcb064-90d2-4208-b93c-b224ffa5f0b9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
63882025-02-23T09:20:54.528ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
63892025-02-23T09:20:54.528ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
63902025-02-23T09:20:54.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63912025-02-23T09:20:54.528ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63922025-02-23T09:20:54.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63932025-02-23T09:20:54.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63942025-02-23T09:20:54.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63952025-02-23T09:20:54.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63962025-02-23T09:20:54.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63972025-02-23T09:20:54.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.337031ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63982025-02-23T09:20:54.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63992025-02-23T09:20:54.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64002025-02-23T09:20:54.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64012025-02-23T09:20:54.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64022025-02-23T09:20:54.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64032025-02-23T09:20:54.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64042025-02-23T09:20:54.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
64052025-02-23T09:20:54.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64062025-02-23T09:20:54.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64072025-02-23T09:20:54.549ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
64082025-02-23T09:20:54.549ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.741138ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
64092025-02-23T09:20:55.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 13fa8b5e-2d48-4bef-be76-41b0d1279308 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64102025-02-23T09:20:55.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 13fa8b5e-2d48-4bef-be76-41b0d1279308 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64112025-02-23T09:20:55.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 13fa8b5e-2d48-4bef-be76-41b0d1279308 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64122025-02-23T09:20:56.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 60e34b12-bb2e-482e-a659-4a0e9b8d2af1 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64132025-02-23T09:20:56.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 60e34b12-bb2e-482e-a659-4a0e9b8d2af1 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64142025-02-23T09:20:56.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 60e34b12-bb2e-482e-a659-4a0e9b8d2af1 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64152025-02-23T09:20:57.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dcd02477-6e46-4e82-9571-55b291c283ce roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64162025-02-23T09:20:57.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dcd02477-6e46-4e82-9571-55b291c283ce resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64172025-02-23T09:20:57.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = dcd02477-6e46-4e82-9571-55b291c283ce response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64182025-02-23T09:20:57.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1077 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 46c4ff9d-082a-4308-a0fd-5b7562c7c286 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
64192025-02-23T09:20:58.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 791f0699-5630-4fca-9b1b-b0988f89924b roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64202025-02-23T09:20:58.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 791f0699-5630-4fca-9b1b-b0988f89924b resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64212025-02-23T09:20:58.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 791f0699-5630-4fca-9b1b-b0988f89924b response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64222025-02-23T09:20:59.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e1ae1699-a5b6-42ab-bee3-c8777102dd56 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64232025-02-23T09:20:59.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e1ae1699-a5b6-42ab-bee3-c8777102dd56 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64242025-02-23T09:20:59.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = e1ae1699-a5b6-42ab-bee3-c8777102dd56 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64252025-02-23T09:21:00.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2eb38411-f3d4-43c7-ad2d-b89009a9f481 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64262025-02-23T09:21:00.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2eb38411-f3d4-43c7-ad2d-b89009a9f481 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64272025-02-23T09:21:00.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 2eb38411-f3d4-43c7-ad2d-b89009a9f481 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64282025-02-23T09:21:01.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8469bf3e-2c79-4787-8a34-3cbb9d0449d6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64292025-02-23T09:21:01.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8469bf3e-2c79-4787-8a34-3cbb9d0449d6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64302025-02-23T09:21:01.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8469bf3e-2c79-4787-8a34-3cbb9d0449d6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64312025-02-23T09:21:02.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a6642173-f12c-4de0-ae12-faebbcd738c0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64322025-02-23T09:21:02.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a6642173-f12c-4de0-ae12-faebbcd738c0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64332025-02-23T09:21:02.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = a6642173-f12c-4de0-ae12-faebbcd738c0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64342025-02-23T09:21:03.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7535a4eb-8a65-4fe5-89b6-2ac864e762b9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64352025-02-23T09:21:03.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7535a4eb-8a65-4fe5-89b6-2ac864e762b9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64362025-02-23T09:21:03.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 7535a4eb-8a65-4fe5-89b6-2ac864e762b9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64372025-02-23T09:21:04.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 679f45fc-135e-4984-a115-95a6e9e4e5f0 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64382025-02-23T09:21:04.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 679f45fc-135e-4984-a115-95a6e9e4e5f0 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64392025-02-23T09:21:04.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 679f45fc-135e-4984-a115-95a6e9e4e5f0 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
64402025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
64412025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
64422025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64432025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64442025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
64452025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
64462025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64472025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
64482025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64492025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64502025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
64512025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
64522025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64532025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
64542025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
64552025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
64562025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64572025-02-23T09:21:04.529ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64582025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64592025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64602025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
64612025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64622025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64632025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
64642025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64652025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
64662025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64672025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
64682025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64692025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
64702025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64712025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
64722025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64732025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
64742025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
64752025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
64762025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64772025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
64782025-02-23T09:21:04.529ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64792025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64802025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64812025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64822025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64832025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64842025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64852025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64862025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64872025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64882025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64892025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64902025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64912025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64922025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64932025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
64942025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64952025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64962025-02-23T09:21:04.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64972025-02-23T09:21:04.532ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.137949ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64982025-02-23T09:21:04.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64992025-02-23T09:21:04.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36280, tv_nsec: 235911221 } })
65002025-02-23T09:21:04.538ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65012025-02-23T09:21:04.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
65022025-02-23T09:21:04.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65032025-02-23T09:21:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65042025-02-23T09:21:04.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65052025-02-23T09:21:04.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65062025-02-23T09:21:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65072025-02-23T09:21:04.542ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65082025-02-23T09:21:04.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65092025-02-23T09:21:04.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65102025-02-23T09:21:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65112025-02-23T09:21:04.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65122025-02-23T09:21:04.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65132025-02-23T09:21:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65142025-02-23T09:21:04.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36280, tv_nsec: 243296319 } })
65152025-02-23T09:21:04.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162025-02-23T09:21:04.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
65172025-02-23T09:21:04.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65182025-02-23T09:21:04.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65192025-02-23T09:21:04.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65202025-02-23T09:21:04.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65212025-02-23T09:21:04.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65222025-02-23T09:21:04.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65232025-02-23T09:21:04.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65242025-02-23T09:21:04.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65252025-02-23T09:21:04.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65262025-02-23T09:21:04.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65272025-02-23T09:21:04.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65282025-02-23T09:21:04.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65292025-02-23T09:21:04.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65302025-02-23T09:21:04.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65312025-02-23T09:21:04.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65322025-02-23T09:21:04.552ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65332025-02-23T09:21:04.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65342025-02-23T09:21:04.562ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65352025-02-23T09:21:04.563ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65362025-02-23T09:21:04.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65372025-02-23T09:21:04.563ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 33.234592ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
65382025-02-23T09:21:04.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65392025-02-23T09:21:04.565ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65402025-02-23T09:21:04.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65412025-02-23T09:21:04.566ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36280, tv_nsec: 264137639 } })
65422025-02-23T09:21:04.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
65432025-02-23T09:21:04.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65442025-02-23T09:21:04.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65452025-02-23T09:21:04.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65462025-02-23T09:21:04.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65472025-02-23T09:21:04.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65482025-02-23T09:21:04.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65492025-02-23T09:21:04.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65502025-02-23T09:21:04.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65512025-02-23T09:21:04.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65522025-02-23T09:21:04.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65532025-02-23T09:21:04.576ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65542025-02-23T09:21:04.576ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65552025-02-23T09:21:04.576ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65562025-02-23T09:21:04.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65572025-02-23T09:21:04.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65582025-02-23T09:21:04.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65592025-02-23T09:21:04.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65602025-02-23T09:21:04.580ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65612025-02-23T09:21:04.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65622025-02-23T09:21:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
65632025-02-23T09:21:04.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65642025-02-23T09:21:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65652025-02-23T09:21:04.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65662025-02-23T09:21:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65672025-02-23T09:21:04.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65682025-02-23T09:21:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65692025-02-23T09:21:04.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65702025-02-23T09:21:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65712025-02-23T09:21:04.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.848208ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
65722025-02-23T09:21:04.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.519831ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
65732025-02-23T09:21:04.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65742025-02-23T09:21:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65752025-02-23T09:21:04.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65762025-02-23T09:21:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65772025-02-23T09:21:04.627ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65782025-02-23T09:21:04.627ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.340451ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65792025-02-23T09:21:04.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.096563ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65802025-02-23T09:21:04.630ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65812025-02-23T09:21:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65822025-02-23T09:21:04.650ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
65832025-02-23T09:21:04.650ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65842025-02-23T09:21:04.651ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82173263-2c7b-4769-92e2-87ec5c71da3f", "content-length": "26", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
65852025-02-23T09:21:04.651ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65862025-02-23T09:21:04.653ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65872025-02-23T09:21:04.663ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
65882025-02-23T09:21:04.663ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65892025-02-23T09:21:04.663ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba271e39-17d3-4341-92ef-ade7fcb582f1", "content-length": "26", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
65902025-02-23T09:21:04.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65912025-02-23T09:21:04.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65922025-02-23T09:21:04.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
65932025-02-23T09:21:04.688ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65942025-02-23T09:21:04.688ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e89d2b1-32d9-41a8-ba1e-0d7452567e78", "content-length": "26", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
65952025-02-23T09:21:04.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65962025-02-23T09:21:04.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
65972025-02-23T09:21:04.694ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65982025-02-23T09:21:04.694ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65992025-02-23T09:21:04.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ed61151-e198-44ab-8223-f2bffa384d5f", "content-length": "372", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66002025-02-23T09:21:04.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66012025-02-23T09:21:04.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66022025-02-23T09:21:04.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66032025-02-23T09:21:04.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66042025-02-23T09:21:04.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66052025-02-23T09:21:04.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66062025-02-23T09:21:04.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66072025-02-23T09:21:04.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
66082025-02-23T09:21:04.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 186.816116ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
66092025-02-23T09:21:04.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66102025-02-23T09:21:04.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66112025-02-23T09:21:04.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66122025-02-23T09:21:04.738ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66132025-02-23T09:21:04.738ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66142025-02-23T09:21:04.738ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 208.686825ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66152025-02-23T09:21:04.738ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66162025-02-23T09:21:04.739ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec78b50c-0381-4c04-a0d2-a666da23b285", "content-length": "2", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66172025-02-23T09:21:04.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 210.203303ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66182025-02-23T09:21:04.741ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66192025-02-23T09:21:04.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66202025-02-23T09:21:04.745ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
66212025-02-23T09:21:04.745ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 215.962761ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66222025-02-23T09:21:04.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 215.88388ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66232025-02-23T09:21:04.748ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 218.324815ms iteration = 26 status = null
66242025-02-23T09:21:04.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66252025-02-23T09:21:04.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
66262025-02-23T09:21:04.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66272025-02-23T09:21:04.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66282025-02-23T09:21:04.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66292025-02-23T09:21:04.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66302025-02-23T09:21:04.758ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 228.787061ms iteration = 26 status = 0
66312025-02-23T09:21:04.759ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.889392ms iteration = 26 status = {}
66322025-02-23T09:21:04.761ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66332025-02-23T09:21:04.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66342025-02-23T09:21:04.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66352025-02-23T09:21:04.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66362025-02-23T09:21:04.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66372025-02-23T09:21:04.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66382025-02-23T09:21:04.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 258.215302ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66392025-02-23T09:21:04.823ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 293.829178ms iteration = 29 status = {"physical_disks_added":0}
66402025-02-23T09:21:04.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66412025-02-23T09:21:04.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66422025-02-23T09:21:04.827ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
66432025-02-23T09:21:04.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66442025-02-23T09:21:04.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66452025-02-23T09:21:04.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66462025-02-23T09:21:04.837ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d2678f6-9467-43e3-9d3a-15976824b83f", "content-length": "134", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66472025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66482025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
66492025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66502025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66512025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66522025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66532025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66542025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66552025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66562025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66572025-02-23T09:21:04.837ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
66582025-02-23T09:21:04.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66592025-02-23T09:21:04.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66602025-02-23T09:21:04.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66612025-02-23T09:21:04.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "82eeb258-6a45-44d2-8662-773d5a083491", "content-length": "2", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66622025-02-23T09:21:04.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66632025-02-23T09:21:04.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8468a43a-8e21-43af-afff-eb40a68edb82", "content-length": "52", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66642025-02-23T09:21:04.840ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
66652025-02-23T09:21:04.840ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66662025-02-23T09:21:04.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f4bcf8aa-d32d-4e19-b156-cd2871615c8b", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66672025-02-23T09:21:04.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66682025-02-23T09:21:04.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66692025-02-23T09:21:04.866ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66702025-02-23T09:21:04.867ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d89c89fe-cf11-4e71-b864-ece0d9e76cf8", "content-length": "691", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66712025-02-23T09:21:04.867ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66722025-02-23T09:21:04.867ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66732025-02-23T09:21:04.867ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66742025-02-23T09:21:04.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66752025-02-23T09:21:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66762025-02-23T09:21:04.869ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.534953ms iteration = 27 status = {}
66772025-02-23T09:21:04.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66782025-02-23T09:21:04.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66792025-02-23T09:21:04.875ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66802025-02-23T09:21:04.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66812025-02-23T09:21:04.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6509743d-f715-46e7-83ac-e292093c9ddc", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66822025-02-23T09:21:04.877ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.795448ms iteration = 27 status = {}
66832025-02-23T09:21:04.950ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7be08175-87cc-4187-94e1-bf2d6f08f7f8", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66842025-02-23T09:21:04.950ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
66852025-02-23T09:21:04.950ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66862025-02-23T09:21:04.954ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcf86825-d244-467f-a927-1e94f989f9c3", "content-length": "682", "date": "Sun, 23 Feb 2025 09:21:04 GMT"} })
66872025-02-23T09:21:04.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66882025-02-23T09:21:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66892025-02-23T09:21:04.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66902025-02-23T09:21:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66912025-02-23T09:21:04.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66922025-02-23T09:21:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66932025-02-23T09:21:04.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66942025-02-23T09:21:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66952025-02-23T09:21:04.970ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 441.221646ms iteration = 26 status = {}
66962025-02-23T09:21:05.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 222acff4-443d-4dca-94c0-49f0c56c9589 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
66972025-02-23T09:21:05.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 222acff4-443d-4dca-94c0-49f0c56c9589 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
66982025-02-23T09:21:05.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 222acff4-443d-4dca-94c0-49f0c56c9589 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
66992025-02-23T09:21:06.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 36dad8d6-cb8b-43b1-a034-60718efaf221 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67002025-02-23T09:21:06.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 36dad8d6-cb8b-43b1-a034-60718efaf221 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67012025-02-23T09:21:06.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 36dad8d6-cb8b-43b1-a034-60718efaf221 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67022025-02-23T09:21:07.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 596 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 192db60f-a7f9-4aa4-82a8-e96cd4b72d51 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
67032025-02-23T09:21:07.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c2d500ce-d50c-4723-a306-537c145a7ca9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67042025-02-23T09:21:07.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c2d500ce-d50c-4723-a306-537c145a7ca9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67052025-02-23T09:21:07.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = c2d500ce-d50c-4723-a306-537c145a7ca9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67062025-02-23T09:21:08.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 664cd746-1613-46a2-9c3f-7ce703ba7686 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67072025-02-23T09:21:08.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 664cd746-1613-46a2-9c3f-7ce703ba7686 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67082025-02-23T09:21:08.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 664cd746-1613-46a2-9c3f-7ce703ba7686 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67092025-02-23T09:21:09.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03449d9e-f891-4652-b296-d4fce8074db6 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67102025-02-23T09:21:09.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03449d9e-f891-4652-b296-d4fce8074db6 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67112025-02-23T09:21:09.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 03449d9e-f891-4652-b296-d4fce8074db6 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67122025-02-23T09:21:10.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4e969f74-a606-4dd5-9ff4-d8eb3043cc27 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67132025-02-23T09:21:10.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4e969f74-a606-4dd5-9ff4-d8eb3043cc27 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67142025-02-23T09:21:10.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4e969f74-a606-4dd5-9ff4-d8eb3043cc27 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67152025-02-23T09:21:11.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b2cd54d-7cb8-4bed-b084-b47435f38256 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67162025-02-23T09:21:11.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b2cd54d-7cb8-4bed-b084-b47435f38256 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67172025-02-23T09:21:11.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9b2cd54d-7cb8-4bed-b084-b47435f38256 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67182025-02-23T09:21:12.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 932710dd-289b-4ed1-be0d-2411a4d4cb98 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67192025-02-23T09:21:12.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 932710dd-289b-4ed1-be0d-2411a4d4cb98 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67202025-02-23T09:21:12.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 932710dd-289b-4ed1-be0d-2411a4d4cb98 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67212025-02-23T09:21:13.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4294d19-e942-4d78-9379-5ab9e063c218 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67222025-02-23T09:21:13.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4294d19-e942-4d78-9379-5ab9e063c218 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67232025-02-23T09:21:13.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f4294d19-e942-4d78-9379-5ab9e063c218 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67242025-02-23T09:21:14.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
67252025-02-23T09:21:14.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
67262025-02-23T09:21:14.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67272025-02-23T09:21:14.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67282025-02-23T09:21:14.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67292025-02-23T09:21:14.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67302025-02-23T09:21:14.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67312025-02-23T09:21:14.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67322025-02-23T09:21:14.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67332025-02-23T09:21:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67342025-02-23T09:21:14.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67352025-02-23T09:21:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67362025-02-23T09:21:14.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67372025-02-23T09:21:14.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67382025-02-23T09:21:14.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67392025-02-23T09:21:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
67402025-02-23T09:21:14.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67412025-02-23T09:21:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67422025-02-23T09:21:14.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
67432025-02-23T09:21:14.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.996872ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
67442025-02-23T09:21:14.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.151861ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67452025-02-23T09:21:14.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d24b155b-1c89-4da0-89fd-d55cdf7d4a33 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67462025-02-23T09:21:14.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d24b155b-1c89-4da0-89fd-d55cdf7d4a33 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67472025-02-23T09:21:14.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = d24b155b-1c89-4da0-89fd-d55cdf7d4a33 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67482025-02-23T09:21:15.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ab635693-e9c6-480c-bfee-856e0c464d9c roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67492025-02-23T09:21:15.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ab635693-e9c6-480c-bfee-856e0c464d9c resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67502025-02-23T09:21:15.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ab635693-e9c6-480c-bfee-856e0c464d9c response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67512025-02-23T09:21:16.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 551cf1a8-07c1-479b-be97-ee6b439acec9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67522025-02-23T09:21:16.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 551cf1a8-07c1-479b-be97-ee6b439acec9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67532025-02-23T09:21:16.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 551cf1a8-07c1-479b-be97-ee6b439acec9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67542025-02-23T09:21:17.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 6ee87969-22bc-459c-bc3a-9be7c8ad03a8 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
67552025-02-23T09:21:17.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cc817883-f839-4b90-ba99-b1dbdc19da15 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67562025-02-23T09:21:17.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cc817883-f839-4b90-ba99-b1dbdc19da15 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67572025-02-23T09:21:17.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = cc817883-f839-4b90-ba99-b1dbdc19da15 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67582025-02-23T09:21:18.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 697e14ae-d877-49a8-879e-dd6411966b68 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67592025-02-23T09:21:18.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 697e14ae-d877-49a8-879e-dd6411966b68 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67602025-02-23T09:21:18.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 697e14ae-d877-49a8-879e-dd6411966b68 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67612025-02-23T09:21:19.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f0657624-eea5-4bcc-9567-b099271a52cb roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67622025-02-23T09:21:19.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f0657624-eea5-4bcc-9567-b099271a52cb resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67632025-02-23T09:21:19.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f0657624-eea5-4bcc-9567-b099271a52cb response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67642025-02-23T09:21:20.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b5f215c3-fe6a-4945-a3a9-b06bd67246f5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67652025-02-23T09:21:20.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b5f215c3-fe6a-4945-a3a9-b06bd67246f5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67662025-02-23T09:21:20.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b5f215c3-fe6a-4945-a3a9-b06bd67246f5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67672025-02-23T09:21:21.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 351233a6-8e80-4ed2-9330-68f223b638d9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
67682025-02-23T09:21:21.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 351233a6-8e80-4ed2-9330-68f223b638d9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
67692025-02-23T09:21:21.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:63496 req_id = 351233a6-8e80-4ed2-9330-68f223b638d9 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
67702025-02-23T09:21:21.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e05e7b3-fec0-4163-a5ff-b89f9696929a roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67712025-02-23T09:21:21.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e05e7b3-fec0-4163-a5ff-b89f9696929a resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67722025-02-23T09:21:21.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 8e05e7b3-fec0-4163-a5ff-b89f9696929a response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67732025-02-23T09:21:22.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 91d37b35-e583-4bdc-b77f-2e4c495dc804 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67742025-02-23T09:21:22.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 91d37b35-e583-4bdc-b77f-2e4c495dc804 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67752025-02-23T09:21:22.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 91d37b35-e583-4bdc-b77f-2e4c495dc804 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67762025-02-23T09:21:23.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5d31e80a-eb5a-4385-9081-96412e6648f2 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67772025-02-23T09:21:23.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5d31e80a-eb5a-4385-9081-96412e6648f2 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67782025-02-23T09:21:23.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5d31e80a-eb5a-4385-9081-96412e6648f2 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
67792025-02-23T09:21:24.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
67802025-02-23T09:21:24.529ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
67812025-02-23T09:21:24.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67822025-02-23T09:21:24.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67832025-02-23T09:21:24.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67842025-02-23T09:21:24.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67852025-02-23T09:21:24.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67862025-02-23T09:21:24.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67872025-02-23T09:21:24.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67882025-02-23T09:21:24.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.351733ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67892025-02-23T09:21:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67902025-02-23T09:21:24.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67912025-02-23T09:21:24.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67922025-02-23T09:21:24.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67932025-02-23T09:21:24.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67942025-02-23T09:21:24.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952025-02-23T09:21:24.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
67962025-02-23T09:21:24.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67972025-02-23T09:21:24.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67982025-02-23T09:21:24.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
67992025-02-23T09:21:24.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.120415ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
68002025-02-23T09:21:24.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f2ef5dd2-80c6-4618-bbf2-10616839a7ef roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68012025-02-23T09:21:24.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f2ef5dd2-80c6-4618-bbf2-10616839a7ef resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68022025-02-23T09:21:24.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f2ef5dd2-80c6-4618-bbf2-10616839a7ef response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68032025-02-23T09:21:25.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5d2a777e-38a1-4837-babd-aab365140aad roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68042025-02-23T09:21:25.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5d2a777e-38a1-4837-babd-aab365140aad resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68052025-02-23T09:21:25.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 5d2a777e-38a1-4837-babd-aab365140aad response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68062025-02-23T09:21:26.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3853c06f-dc14-4628-8905-c9b2542fd786 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68072025-02-23T09:21:26.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3853c06f-dc14-4628-8905-c9b2542fd786 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68082025-02-23T09:21:26.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3853c06f-dc14-4628-8905-c9b2542fd786 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68092025-02-23T09:21:27.286ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 587 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 7a00106e-a307-4001-a8d1-fc6556f1d37c response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
68102025-02-23T09:21:27.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3de198fd-7d1a-4fa3-b166-ec98ff7ae789 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68112025-02-23T09:21:27.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3de198fd-7d1a-4fa3-b166-ec98ff7ae789 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68122025-02-23T09:21:27.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 3de198fd-7d1a-4fa3-b166-ec98ff7ae789 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68132025-02-23T09:21:28.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 22f226bc-b83f-4122-9add-467f1daf9165 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68142025-02-23T09:21:28.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 22f226bc-b83f-4122-9add-467f1daf9165 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68152025-02-23T09:21:28.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 22f226bc-b83f-4122-9add-467f1daf9165 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68162025-02-23T09:21:29.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f12f8b43-e8a2-4983-9b75-98de68c10d2e roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68172025-02-23T09:21:29.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f12f8b43-e8a2-4983-9b75-98de68c10d2e resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68182025-02-23T09:21:29.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = f12f8b43-e8a2-4983-9b75-98de68c10d2e response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68192025-02-23T09:21:30.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b26e525d-bfdc-44b1-a752-f0e0a24e87d5 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68202025-02-23T09:21:30.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b26e525d-bfdc-44b1-a752-f0e0a24e87d5 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68212025-02-23T09:21:30.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = b26e525d-bfdc-44b1-a752-f0e0a24e87d5 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68222025-02-23T09:21:31.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9f9410ed-8e1e-46bf-8b2a-0ddea670b825 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68232025-02-23T09:21:31.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9f9410ed-8e1e-46bf-8b2a-0ddea670b825 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68242025-02-23T09:21:31.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 9f9410ed-8e1e-46bf-8b2a-0ddea670b825 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68252025-02-23T09:21:32.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eaa7ac5e-00d8-4156-b899-aa9cbdd56965 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68262025-02-23T09:21:32.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eaa7ac5e-00d8-4156-b899-aa9cbdd56965 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68272025-02-23T09:21:32.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = eaa7ac5e-00d8-4156-b899-aa9cbdd56965 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68282025-02-23T09:21:33.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0bc8c3df-dcf7-41a5-9cce-feee9063afd4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68292025-02-23T09:21:33.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0bc8c3df-dcf7-41a5-9cce-feee9063afd4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68302025-02-23T09:21:33.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 0bc8c3df-dcf7-41a5-9cce-feee9063afd4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
68312025-02-23T09:21:34.529ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
68322025-02-23T09:21:34.529ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
68332025-02-23T09:21:34.529ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68342025-02-23T09:21:34.529ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
68352025-02-23T09:21:34.529ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-23 09:11:34.529883949 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68362025-02-23T09:21:34.529ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
68372025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68382025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
68392025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68402025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
68412025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68422025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
68432025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68442025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68452025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68462025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
68472025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
68482025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68492025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68502025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
68512025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
68522025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68532025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68542025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
68552025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68562025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
68572025-02-23T09:21:34.530ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68582025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
68592025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68602025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68612025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
68622025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68632025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
68642025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
68652025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68662025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
68672025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68682025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68692025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68702025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
68712025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
68722025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68732025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
68742025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
68752025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68762025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
68772025-02-23T09:21:34.530ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68782025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68792025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
68802025-02-23T09:21:34.530ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27
68812025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.8\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27"}
68822025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
68832025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
68842025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
68852025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
68862025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68872025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
68882025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68892025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
68902025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68912025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
68922025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68932025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
68942025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68952025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
68962025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
68972025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68982025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68992025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69002025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69012025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69022025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69032025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69042025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69052025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69062025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69072025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69082025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69092025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69102025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69112025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69122025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69132025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69142025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69152025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69162025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
69172025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69182025-02-23T09:21:34.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69192025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69202025-02-23T09:21:34.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("54837768-c843-4ec9-bd3b-c9b189b1b07e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4eed87a-fe22-4a1d-8d93-25bee968f9d1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d681d220-bdd0-4ed7-bcd5-3445bfe35e44.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 36310, tv_nsec: 228574907 } })
69212025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69222025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69232025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69242025-02-23T09:21:34.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a04c699-57fd-4088-9fd0-fe8bfd6f8efc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3ffb120-bf15-43b5-89a1-5c5964c0413c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 36310, tv_nsec: 228683349 } })
69252025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69262025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.214313ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69272025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
69282025-02-23T09:21:34.531ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.732862ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
69292025-02-23T09:21:34.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69302025-02-23T09:21:34.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69312025-02-23T09:21:34.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69322025-02-23T09:21:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69332025-02-23T09:21:34.534ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-23 09:11:34.529883949 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69342025-02-23T09:21:34.534ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.25085ms iteration = 14 status = {"expiration":"2025-02-23T09:11:34.529883949Z","pruned":[]}
69352025-02-23T09:21:34.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69362025-02-23T09:21:34.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.061193ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69372025-02-23T09:21:34.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69382025-02-23T09:21:34.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69392025-02-23T09:21:34.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36310, tv_nsec: 234344915 } })
69402025-02-23T09:21:34.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
69412025-02-23T09:21:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69422025-02-23T09:21:34.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69432025-02-23T09:21:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69442025-02-23T09:21:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69452025-02-23T09:21:34.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69462025-02-23T09:21:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69472025-02-23T09:21:34.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69482025-02-23T09:21:34.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69492025-02-23T09:21:34.541ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69502025-02-23T09:21:34.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69512025-02-23T09:21:34.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69522025-02-23T09:21:34.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532025-02-23T09:21:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69542025-02-23T09:21:34.546ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69552025-02-23T09:21:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69562025-02-23T09:21:34.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69572025-02-23T09:21:34.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69582025-02-23T09:21:34.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69592025-02-23T09:21:34.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69602025-02-23T09:21:34.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69612025-02-23T09:21:34.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69622025-02-23T09:21:34.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632025-02-23T09:21:34.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69642025-02-23T09:21:34.549ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69652025-02-23T09:21:34.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36310, tv_nsec: 247934229 } })
69662025-02-23T09:21:34.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
69672025-02-23T09:21:34.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69682025-02-23T09:21:34.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69692025-02-23T09:21:34.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69702025-02-23T09:21:34.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69712025-02-23T09:21:34.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69722025-02-23T09:21:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69732025-02-23T09:21:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69742025-02-23T09:21:34.553ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69752025-02-23T09:21:34.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69762025-02-23T09:21:34.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69772025-02-23T09:21:34.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69782025-02-23T09:21:34.571ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 40.659901ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
69792025-02-23T09:21:34.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69802025-02-23T09:21:34.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69812025-02-23T09:21:34.574ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
69822025-02-23T09:21:34.574ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
69832025-02-23T09:21:34.574ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 43.777679ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
69842025-02-23T09:21:34.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69852025-02-23T09:21:34.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 36310, tv_nsec: 273024398 } })
69862025-02-23T09:21:34.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69872025-02-23T09:21:34.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
69882025-02-23T09:21:34.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69892025-02-23T09:21:34.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69902025-02-23T09:21:34.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69912025-02-23T09:21:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69922025-02-23T09:21:34.580ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69932025-02-23T09:21:34.580ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69942025-02-23T09:21:34.580ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69952025-02-23T09:21:34.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69962025-02-23T09:21:34.581ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69972025-02-23T09:21:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69982025-02-23T09:21:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69992025-02-23T09:21:34.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70002025-02-23T09:21:34.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70012025-02-23T09:21:34.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70022025-02-23T09:21:34.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70032025-02-23T09:21:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70042025-02-23T09:21:34.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70052025-02-23T09:21:34.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70062025-02-23T09:21:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70072025-02-23T09:21:34.600ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70082025-02-23T09:21:34.600ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.507839ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70092025-02-23T09:21:34.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70102025-02-23T09:21:34.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70112025-02-23T09:21:34.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122025-02-23T09:21:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70132025-02-23T09:21:34.618ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70142025-02-23T09:21:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70152025-02-23T09:21:34.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70162025-02-23T09:21:34.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70172025-02-23T09:21:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70182025-02-23T09:21:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70192025-02-23T09:21:34.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70202025-02-23T09:21:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70212025-02-23T09:21:34.625ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
70222025-02-23T09:21:34.625ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 95.339574ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
70232025-02-23T09:21:34.626ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70242025-02-23T09:21:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70252025-02-23T09:21:34.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.370447ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70262025-02-23T09:21:34.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 112.947964ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
70272025-02-23T09:21:34.643ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70282025-02-23T09:21:34.644ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70292025-02-23T09:21:34.644ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70302025-02-23T09:21:34.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70312025-02-23T09:21:34.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70322025-02-23T09:21:34.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 114.558144ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
70332025-02-23T09:21:34.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70342025-02-23T09:21:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70352025-02-23T09:21:34.647ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 117.307025ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
70362025-02-23T09:21:34.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70372025-02-23T09:21:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70382025-02-23T09:21:34.654ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70392025-02-23T09:21:34.654ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
70402025-02-23T09:21:34.654ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.941459ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70412025-02-23T09:21:34.656ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70422025-02-23T09:21:34.656ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70432025-02-23T09:21:34.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70442025-02-23T09:21:34.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70452025-02-23T09:21:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70462025-02-23T09:21:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70472025-02-23T09:21:34.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70482025-02-23T09:21:34.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70492025-02-23T09:21:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70502025-02-23T09:21:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f3c82b21-e2fe-4d04-93d1-3b1d87f59c27, lookup_type: ById(f3c82b21-e2fe-4d04-93d1-3b1d87f59c27) } result = Ok(())
70512025-02-23T09:21:34.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70522025-02-23T09:21:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70532025-02-23T09:21:34.678ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
70542025-02-23T09:21:34.678ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
70552025-02-23T09:21:34.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70562025-02-23T09:21:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70572025-02-23T09:21:34.678ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70582025-02-23T09:21:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70592025-02-23T09:21:34.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70602025-02-23T09:21:34.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70612025-02-23T09:21:34.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70622025-02-23T09:21:34.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70632025-02-23T09:21:34.695ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
70642025-02-23T09:21:34.695ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70652025-02-23T09:21:34.696ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38e85df4-c97f-4834-8ecc-da41408ecb18", "content-length": "26", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} })
70662025-02-23T09:21:34.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70672025-02-23T09:21:34.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
70682025-02-23T09:21:34.697ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70692025-02-23T09:21:34.697ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c8c362a-5ece-48ec-8eab-2ed148686188", "content-length": "26", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} })
70702025-02-23T09:21:34.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70712025-02-23T09:21:34.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70722025-02-23T09:21:34.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70732025-02-23T09:21:34.704ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
70742025-02-23T09:21:34.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 174.158279ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
70752025-02-23T09:21:34.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 zone_address = fd00:1122:3344:101::2
70762025-02-23T09:21:34.711ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70772025-02-23T09:21:34.711ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc5301ff-d196-4c51-9048-bc9abc559d5d", "content-length": "26", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} })
70782025-02-23T09:21:34.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70792025-02-23T09:21:34.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
70802025-02-23T09:21:34.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70812025-02-23T09:21:34.730ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70822025-02-23T09:21:34.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70832025-02-23T09:21:34.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70842025-02-23T09:21:34.880ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70852025-02-23T09:21:34.880ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be9331b-b5bb-4ae0-822b-dbb5450eb794", "content-length": "2", "date": "Sun, 23 Feb 2025 09:21:33 GMT"} })
70862025-02-23T09:21:34.881ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70872025-02-23T09:21:34.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70882025-02-23T09:21:34.882ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 352.891484ms iteration = 27 status = {}
70892025-02-23T09:21:34.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70902025-02-23T09:21:34.948ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70912025-02-23T09:21:34.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70922025-02-23T09:21:34.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932025-02-23T09:21:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70942025-02-23T09:21:34.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70952025-02-23T09:21:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70962025-02-23T09:21:34.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70972025-02-23T09:21:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70982025-02-23T09:21:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70992025-02-23T09:21:34.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71002025-02-23T09:21:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 427.941688ms iteration = 27 status = null
71012025-02-23T09:21:34.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71022025-02-23T09:21:34.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71032025-02-23T09:21:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71042025-02-23T09:21:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71052025-02-23T09:21:34.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71062025-02-23T09:21:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71072025-02-23T09:21:34.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71082025-02-23T09:21:34.964ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 90eaab82-cca9-4912-80b2-885254096ff9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71092025-02-23T09:21:34.964ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71102025-02-23T09:21:34.964ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-23 09:08:53.603595 UTC dns_group = internal generation = 1
71112025-02-23T09:21:34.964ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 434.836267ms iteration = 14 status = {"generation":1}
71122025-02-23T09:21:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b, lookup_type: ById(367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) } result = Ok(())
71132025-02-23T09:21:34.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71142025-02-23T09:21:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71152025-02-23T09:21:34.968ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 438.456525ms iteration = 27 status = 0
71162025-02-23T09:21:34.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 original_time_created = 2025-02-23 09:08:26.843140 UTC target_id = f3c82b21-e2fe-4d04-93d1-3b1d87f59c27 time_created = 2025-02-23 09:08:26.843140 UTC
71172025-02-23T09:21:34.971ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 441.151475ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f3c82b21-e2fe-4d04-93d1-3b1d87f59c27","time_created":"2025-02-23T09:08:26.843140Z"}
71182025-02-23T09:21:34.975ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71192025-02-23T09:21:34.975ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "96807f4d-010c-4d89-b5b7-7df79940d1cd", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71202025-02-23T09:21:34.975ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71212025-02-23T09:21:34.977ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "653cb7ca-a7b7-482c-b4a0-71d63e7c0d34", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71222025-02-23T09:21:34.977ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71232025-02-23T09:21:34.978ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71242025-02-23T09:21:34.978ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 448.521043ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71252025-02-23T09:21:34.981ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71262025-02-23T09:21:34.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71272025-02-23T09:21:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 459.795334ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71282025-02-23T09:21:35.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 473.606252ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71292025-02-23T09:21:35.006ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71302025-02-23T09:21:35.006ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71312025-02-23T09:21:35.006ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 0 version = 2
71322025-02-23T09:21:35.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71332025-02-23T09:21:35.007ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "832d054b-afff-43ac-80db-12059e66d078", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71342025-02-23T09:21:35.007ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71352025-02-23T09:21:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71362025-02-23T09:21:35.008ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71372025-02-23T09:21:35.008ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71382025-02-23T09:21:35.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71392025-02-23T09:21:35.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71402025-02-23T09:21:35.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fb90f781-8125-4b28-84e2-d3afdd0acdf7", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71412025-02-23T09:21:35.009ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71422025-02-23T09:21:35.010ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-23T09:08:30.062867Z, time_modified: 2025-02-23T09:08:30.062867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, db_silo: Silo { identity: SiloIdentity { id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-23T09:08:54.280677Z, time_modified: 2025-02-23T09:08:54.280677Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a" }] }) }
71432025-02-23T09:21:35.010ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 480.91583ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]}},"default_endpoint":{"silo_id":"e9f38e2e-3bd8-4187-a100-da5edd2fe30a","tls_certs":["73874e7a27d0dec11f98bc3554f66ba418ce07f9d79d681e864943057bb8a64a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71442025-02-23T09:21:35.011ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "520d7c5f-c5ec-4271-9c3b-09bcf8b78b1c", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71452025-02-23T09:21:35.011ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71462025-02-23T09:21:35.013ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71472025-02-23T09:21:35.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.734992ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71482025-02-23T09:21:35.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 492.613268ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71492025-02-23T09:21:35.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 901cc4db-4e0b-49aa-a1f8-22e16c950fe4 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
71502025-02-23T09:21:35.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 901cc4db-4e0b-49aa-a1f8-22e16c950fe4 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
71512025-02-23T09:21:35.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d23d2b22-dd11-4985-be31-4735fea6bf97", "content-length": "372", "date": "Sun, 23 Feb 2025 09:21:35 GMT"} })
71522025-02-23T09:21:35.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71532025-02-23T09:21:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71542025-02-23T09:21:35.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 901cc4db-4e0b-49aa-a1f8-22e16c950fe4 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
71552025-02-23T09:21:35.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71562025-02-23T09:21:35.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71572025-02-23T09:21:35.039ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: beb1fad8-c4c1-498f-bef6-61b218f3dbb0, rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e) } rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
71582025-02-23T09:21:35.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71592025-02-23T09:21:35.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71602025-02-23T09:21:35.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71612025-02-23T09:21:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71622025-02-23T09:21:35.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71632025-02-23T09:21:35.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71642025-02-23T09:21:35.045ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71652025-02-23T09:21:35.045ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71662025-02-23T09:21:35.045ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 515.766101ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71672025-02-23T09:21:35.046ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 64e4cabe-92f7-42a0-8b90-5e7eeed96fd5 dns_zone_name = oxide.test found_so_far = 1 version = 2
71682025-02-23T09:21:35.046ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71692025-02-23T09:21:35.047ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-23 09:08:54.358354 UTC dns_group = external generation = 2
71702025-02-23T09:21:35.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 517.044615ms iteration = 14 status = {"generation":2}
71712025-02-23T09:21:35.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71722025-02-23T09:21:35.050ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "12d271f0-021f-4e0d-a5fa-0b0ec90d623f", "content-length": "134", "date": "Sun, 23 Feb 2025 09:21:35 GMT"} })
71732025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71742025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ef6376c2-abb9-48a2-bcdb-afd3ac3aa77e
71752025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71762025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71772025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71782025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71792025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71802025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71812025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71822025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71832025-02-23T09:21:35.050ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026
71842025-02-23T09:21:35.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71852025-02-23T09:21:35.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71862025-02-23T09:21:35.053ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71872025-02-23T09:21:35.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9685d259-1889-42a1-a4fd-3484d074e420", "content-length": "2", "date": "Sun, 23 Feb 2025 09:21:35 GMT"} })
71882025-02-23T09:21:35.053ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71892025-02-23T09:21:35.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e98b0a6f-3db2-4bb8-87fc-0c14bb785b3f", "content-length": "52", "date": "Sun, 23 Feb 2025 09:21:35 GMT"} })
71902025-02-23T09:21:35.053ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch_location = Switch0
71912025-02-23T09:21:35.053ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71922025-02-23T09:21:35.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71932025-02-23T09:21:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71942025-02-23T09:21:35.074ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 544.318056ms iteration = 30 status = {"physical_disks_added":0}
71952025-02-23T09:21:35.080ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71962025-02-23T09:21:35.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71972025-02-23T09:21:35.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71982025-02-23T09:21:35.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71992025-02-23T09:21:35.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72002025-02-23T09:21:35.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72012025-02-23T09:21:35.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72022025-02-23T09:21:35.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72032025-02-23T09:21:35.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72042025-02-23T09:21:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72052025-02-23T09:21:35.157ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e20e3dff-df12-483e-8869-bd59517dda52", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} })
72062025-02-23T09:21:35.157ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 switch = Switch0
72072025-02-23T09:21:35.157ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72082025-02-23T09:21:35.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dfd6bf34-3808-4de2-a9c0-09ff7b4b0b96", "date": "Sun, 23 Feb 2025 09:21:35 GMT"} })
72092025-02-23T09:21:35.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72102025-02-23T09:21:35.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72112025-02-23T09:21:35.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 38f3d9f8-4c95-4159-994a-e2f97a9a0026 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7a44a38-aa86-4122-9938-06b419249887", "content-length": "682", "date": "Sun, 23 Feb 2025 09:21:35 GMT"} })
72122025-02-23T09:21:35.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72132025-02-23T09:21:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72142025-02-23T09:21:35.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72152025-02-23T09:21:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72162025-02-23T09:21:35.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72172025-02-23T09:21:35.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72182025-02-23T09:21:35.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72192025-02-23T09:21:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72202025-02-23T09:21:35.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72212025-02-23T09:21:35.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72222025-02-23T09:21:35.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72232025-02-23T09:21:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72242025-02-23T09:21:35.167ZINFOnexus (BackgroundTasks): VPC route manager sled 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72252025-02-23T09:21:35.167ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72262025-02-23T09:21:35.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "18d88d91-1035-46ec-89a0-cadddde306f3", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} })
72272025-02-23T09:21:35.169ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 639.69777ms iteration = 28 status = {}
72282025-02-23T09:21:35.174ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 644.186224ms iteration = 27 status = {}
72292025-02-23T09:21:35.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72302025-02-23T09:21:35.209ZDEBGnexus (BackgroundTasks): client response SledAgent = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a65070aa-dcc2-402b-9caa-ea4cebc6c587", "content-length": "691", "date": "Sun, 23 Feb 2025 09:21:34 GMT"} })
72312025-02-23T09:21:35.209ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72322025-02-23T09:21:35.209ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72332025-02-23T09:21:35.209ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72342025-02-23T09:21:35.211ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 681.40976ms iteration = 28 status = {}
72352025-02-23T09:21:36.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 96097ade-c750-46c9-81a9-5e855762db22 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72362025-02-23T09:21:36.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 96097ade-c750-46c9-81a9-5e855762db22 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72372025-02-23T09:21:36.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 96097ade-c750-46c9-81a9-5e855762db22 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72382025-02-23T09:21:37.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ec2262da-e5c6-4c5b-90a9-06d53fadc5db roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72392025-02-23T09:21:37.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ec2262da-e5c6-4c5b-90a9-06d53fadc5db resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72402025-02-23T09:21:37.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ec2262da-e5c6-4c5b-90a9-06d53fadc5db response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72412025-02-23T09:21:37.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::c]:40625 method = GET remote_addr = [fd00:1122:3344:101::d]:42138 req_id = 68bf20a8-0ac2-4368-bbc6-62c99da043e7 response_code = 200 uri = /1c608ad8-8827-4c81-ba57-e92e029dcde3
72422025-02-23T09:21:38.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b3c14f0-037f-4367-a4f5-90ffc6dfa6e8 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72432025-02-23T09:21:38.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b3c14f0-037f-4367-a4f5-90ffc6dfa6e8 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72442025-02-23T09:21:38.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 4b3c14f0-037f-4367-a4f5-90ffc6dfa6e8 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72452025-02-23T09:21:39.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 95118119-c581-48ad-83d1-41d6798ac672 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72462025-02-23T09:21:39.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 95118119-c581-48ad-83d1-41d6798ac672 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72472025-02-23T09:21:39.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 95118119-c581-48ad-83d1-41d6798ac672 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72482025-02-23T09:21:40.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ae6e77ea-8ffe-462f-8f2f-5afba903fcf7 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72492025-02-23T09:21:40.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ae6e77ea-8ffe-462f-8f2f-5afba903fcf7 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72502025-02-23T09:21:40.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = ae6e77ea-8ffe-462f-8f2f-5afba903fcf7 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72512025-02-23T09:21:41.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 408a71cc-8192-48f8-9313-7f2b303b05c9 roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72522025-02-23T09:21:41.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 408a71cc-8192-48f8-9313-7f2b303b05c9 resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72532025-02-23T09:21:41.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 408a71cc-8192-48f8-9313-7f2b303b05c9 response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72542025-02-23T09:21:42.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 135427f3-4d60-48cd-a53c-0cd0bbdb42db roles = RoleSet { roles: {} } uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72552025-02-23T09:21:42.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 135427f3-4d60-48cd-a53c-0cd0bbdb42db resource = Database result = Ok(()) uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
72562025-02-23T09:21:42.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65079 req_id = 135427f3-4d60-48cd-a53c-0cd0bbdb42db response_code = 200 uri = /probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b